00000001:02000400:2.0F:1788658210.940774:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788658236.829115:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788658238.842138:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 388 MB/s 00000001:01000000:3.0:1788658239.095356:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 603 MB/s 00000001:01000000:2.0:1788658239.345216:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3551 MB/s 00000020:02000000:3.0:1788658240.507008:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g2c24a36 00000400:02000000:0.0F:1788658241.691037:0:3288:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.103@tcp [8/256/0/180] 00008000:02000000:2.0:1788658245.529061:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1788658292.679030:0:5238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788658301.611094:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788658301.611100:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788658301.611252:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006b50a14b 00000080:02000400:1.0:1788658301.611264:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788658301.617790:0:5818:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788658301.617804:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788658301.617948:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bbde2a80) 00000020:00000080:0.0:1788658301.617973:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788658301.634363:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788658301.634954:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788658301.655724:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788658301.655765:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788658301.655785:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788658301.655835:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788658301.655862:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788658301.656422:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788658301.656432:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788658301.656562:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ea77a 00000020:01000004:1.0:1788658301.656572:0:5818:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788658301.656577:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788658301.656582:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b50a14b from MGS 00000020:01000004:1.0:1788658301.656587:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788658301.656615:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000200ccf57) 00000020:00000080:1.0:1788658301.656626:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788658301.656847:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b50a14b from MGS, refs=2 00080000:01000000:1.0:1788658301.656854:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788658301.656859:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ea788 00000100:00100000:1.0:1788658301.656975:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788658301.657117:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788658301.657124:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788658301.657890:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788658301.657899:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788658301.658872:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658301.659055:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788658301.659067:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788658301.660057:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788658301.660066:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788658301.660834:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788658301.660842:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788658301.661641:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658301.661645:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658301.661647:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658301.662109:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658301.662112:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658301.662114:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658301.662776:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788658301.667626:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788658301.911924:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4251 MB/s 00000001:01000000:3.0:1788658302.161818:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4043 MB/s 00000001:01000000:3.0:1788658302.411964:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 671 MB/s 00000001:01000000:3.0:1788658302.662398:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 723 MB/s 00010000:00010000:3.0:1788658302.685405:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788658302.688346:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788658302.708834:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788658302.708854:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788658302.708856:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788658302.717694:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788658302.717837:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788658302.717907:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788658302.718184:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788658302.718222:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788658302.718822:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658302.718994:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788658302.719002:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788658302.722881:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788658302.722897:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788658302.724239:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788658302.724248:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788658302.731527:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788658302.731879:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788658302.731901:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.103@tcp' 00000020:01000004:2.0:1788658302.731903:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788658302.731955:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.103@tcp (typ=mgc) 00000020:00000080:2.0:1788658302.731974:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.103@tcp (000000000bed4b80) 00000020:00000080:2.0:1788658302.731994:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788658302.732098:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002babdb88@MGC192.168.202.103@tcp: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1788658302.732271:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.103@tcp-0 is initialized 00000040:01000000:2.0:1788658302.732277:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788658302.743239:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788658302.743299:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.103@tcp (uuid 88ab4306-42c5-43ae-b202-256d86278024) 00000020:00000080:2.0:1788658302.743323:0:5818:0:(genops.c:1385:class_connect()) connect: client 88ab4306-42c5-43ae-b202-256d86278024, cookie 0xf657f176650ea796 00000100:00080000:2.0:1788658302.743337:0:5818:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658302.743343:0:5818:0:(import.c:665:import_select_connection()) MGC192.168.202.103@tcp: import 000000002babdb88 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658302.743403:0:5818:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009110a666 x1875544103714944/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658302.743425:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 88ab4306-42c5-43ae-b202-256d86278024->MGS 00000020:01000004:2.0:1788658302.743443:0:5818:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788658302.743449:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788658302.743462:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005136c3dd) 00000020:00000080:2.0:1788658302.743475:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788658302.746617:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009110a666 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88ab4306-42c5-43ae-b202-256d86278024:3303:1875544103714944:0@lo:250: 00000100:00100000:0.0:1788658302.746753:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658302.746827:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103714944 00000100:00100000:0.0:1788658302.746835:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103714944 00000100:00100000:0.0:1788658302.746872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658302.746878:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0720008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875544103714944:12345-0@lo:250: 00010000:00080000:0.0:1788658302.746905:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 88ab4306-42c5-43ae-b202-256d86278024@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1788658302.746941:0:5830:0:(genops.c:1385:class_connect()) connect: client 88ab4306-42c5-43ae-b202-256d86278024, cookie 0xf657f176650ea7a4 00000100:00080000:0.0:1788658302.747083:0:5830:0:(import.c:65:import_set_state_nolock()) 0000000017d07b45 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658302.747133:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0720008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+5:3303:x1875544103714944:12345-0@lo:250: Request processed in 253us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658302.747141:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658302.747189:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788658302.747212:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1788658302.747228:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788658302.747234:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788658302.747238:0:3303:0:(import.c:65:import_set_state_nolock()) 000000002babdb88 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788658302.747241:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788658302.747248:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788658302.747254:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009110a666 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88ab4306-42c5-43ae-b202-256d86278024:3303:1875544103714944:0@lo:250: 00000100:00100000:2.0:1788658302.768867:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658302.769101:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658302.769110:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788658302.771118:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658302.771134:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788658302.771497:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658302.771511:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788658302.772475:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658302.773208:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788658302.773215:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788658302.773939:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788658302.773948:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788658302.818868:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658302.819097:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788658302.819105:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788658302.825120:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788658302.825137:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788658302.826367:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658302.826643:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788658302.826650:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788658302.827342:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788658302.827350:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788658302.828492:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658302.828969:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788658302.828976:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788658302.832013:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788658302.832037:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788658302.833150:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658302.833334:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788658302.833347:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788658302.839374:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788658302.839388:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788658302.878063:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658302.878310:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788658302.878319:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788658302.881967:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658302.881982:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788658302.884302:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788658302.884320:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788658302.887631:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788658302.888239:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788658302.888250:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788658302.888384:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658302.888413:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788658302.888416:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658302.888417:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658302.888418:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658302.888419:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658302.888420:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658302.888421:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658302.888422:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658302.888423:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658302.888424:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658302.888424:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658302.888425:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658302.888427:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658302.888428:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788658302.888430:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658302.888430:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658302.888431:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658302.888432:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658302.888432:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658302.888433:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658302.888433:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658302.888434:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658302.888434:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658302.888435:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658302.888438:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658302.888439:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658302.888478:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788658302.888495:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715072:0@lo:253: 00000100:00100000:0.0:1788658302.888589:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658302.888643:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000009351b883 going to sleep for 11 seconds 00000100:00100000:1.0:1788658302.888648:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715072 00000100:00100000:1.0:1788658302.888657:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715072 00000100:00100000:0.0:1788658302.890192:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658302.890214:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b570c922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+5:5818:x1875544103715072:12345-0@lo:253: 20000000:01000000:0.0:1788658302.890276:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788658302.890280:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788658302.890704:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788658302.890801:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788658302.891110:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658302.892873:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788658302.894710:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788658302.894716:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788658302.894724:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788658302.894726:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788658302.894743:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788658302.895013:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658302.895281:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788658302.895295:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788658302.895346:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788658302.895413:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788658302.895452:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788658302.897408:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788658302.897429:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788658302.897741:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788658302.897751:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788658302.897786:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788658302.897793:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788658302.897822:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788658302.897871:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788658302.897942:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788658302.897949:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788658302.897967:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658302.898285:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788658302.898297:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788658302.898331:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788658302.898368:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788658302.898417:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788658302.898430:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788658302.898889:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788658302.898901:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788658302.898963:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788658302.899002:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788658302.899040:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788658302.899053:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788658302.899141:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788658302.899151:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788658302.899210:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788658302.899250:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788658302.899424:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788658302.899473:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788658302.899481:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788658302.900222:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788658302.900761:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788658302.900785:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.103@tcp for mdt 20000000:01000000:0.0:1788658302.900787:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:0.0:1788658302.900824:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788658302.900831:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788658302.900859:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788658302.900866:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:0.0:1788658302.900925:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788658302.903353:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788658302.903467:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788658302.903704:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788658302.903826:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788658302.903830:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788658302.903836:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788658302.903843:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788658302.905076:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788658302.905230:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788658302.913885:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788658302.913943:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788658302.914087:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788658302.914108:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788658302.914111:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788658302.914115:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788658302.914131:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788658302.914134:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788658302.914171:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788658302.914174:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788658302.915596:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788658302.916484:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788658302.916545:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788658302.916580:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788658302.916594:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788658302.916596:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788658302.917979:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788658302.918447:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788658302.918906:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788658302.919001:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1788658302.919046:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788658302.919050:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788658302.919058:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788658302.919082:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919098:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919109:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919115:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919121:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919128:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919134:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a6270244 already unused, calling callback (00000000367121a8) 00010000:00010000:0.0:1788658302.919138:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919268:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919282:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919289:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658302.919307:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a6270244/0xf657f176650ea7ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658302.919324:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788658303.140388:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b570c922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+5:5818:x1875544103715072:12345-0@lo:253: Request processed in 250171us (251792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658303.140408:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658303.140495:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715072:0@lo:253: 10000000:01000000:0.0:1788658303.140513:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788658303.140572:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658303.140574:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658303.140575:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658303.140577:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788658303.140578:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658303.140579:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658303.140580:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658303.140582:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658303.140583:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788658303.140585:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658303.140586:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788658303.140606:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b50a14b from lustre-MDT0000 10000000:01000000:0.0:1788658303.140630:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788658303.140633:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788658303.140638:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e56c56c19c0 10000000:01000000:0.0:1788658303.140642:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658303.140650:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e56c56c19c0 from 1 10000000:01000000:0.0:1788658303.140652:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788658303.140754:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000a6270244/0xf657f176650ea7b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.140765:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000a6270244/0xf657f176650ea7b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.140774:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000a6270244/0xf657f176650ea7b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.140809:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715200:0@lo:101: 00000100:00100000:0.0:1788658303.140846:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.140934:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e4479c6 going to sleep for 11 seconds 00000100:00100000:1.0:1788658303.141017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715200 00000100:00100000:1.0:1788658303.141026:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715200 00000100:00100000:1.0:1788658303.141098:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658303.141106:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe51eafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+5:5818:x1875544103715200:12345-0@lo:101: 00010000:00010000:1.0:1788658303.141118:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658303.141131:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096d9b1f4/0xf657f176650ea7b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea7b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.141153:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096d9b1f4/0xf657f176650ea7b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.141163:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096d9b1f4/0xf657f176650ea7b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.141172:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096d9b1f4, rc 0) 00000100:00100000:1.0:1788658303.141205:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe51eafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+6:5818:x1875544103715200:12345-0@lo:101: Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658303.141220:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658303.141281:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715200:0@lo:101: 00010000:00010000:0.0:1788658303.141292:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000a6270244/0xf657f176650ea7b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.141301:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000a6270244/0xf657f176650ea7b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.141344:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715328:0@lo:501: 00000100:00100000:0.0:1788658303.141364:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.141453:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e4479c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788658303.141508:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715328 00000100:00100000:2.0:1788658303.141512:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715328 00000100:00100000:2.0:1788658303.141537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658303.141542:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e9be084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+6:5818:x1875544103715328:12345-0@lo:501: 00000100:00100000:2.0:1788658303.141789:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e9be084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+6:5818:x1875544103715328:12345-0@lo:501: Request processed in 246us (423us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658303.141796:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658303.141861:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715328:0@lo:501: 10000000:01000000:0.0:1788658303.141883:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788658303.141899:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 00000000a6270244/0xf657f176650ea7b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.141907:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 00000000a6270244/0xf657f176650ea7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658303.141914:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56f44c2000 10000000:01000000:0.0:1788658303.141917:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788658303.141921:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e56f44c2000 10000000:01000000:0.0:1788658303.141923:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788658303.141925:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e56f44c2000 from 1 10000000:01000000:0.0:1788658303.141931:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788658303.141946:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 0000000044464fd5/0xf657f176650ea7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.141952:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 0000000044464fd5/0xf657f176650ea7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.141959:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 0000000044464fd5/0xf657f176650ea7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.141969:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715456:0@lo:101: 00000100:00100000:0.0:1788658303.141992:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.142008:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e4479c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788658303.142117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715456 00000100:00100000:2.0:1788658303.142121:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715456 00000100:00100000:2.0:1788658303.142136:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658303.142141:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a7e55d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+6:5818:x1875544103715456:12345-0@lo:101: 00010000:00010000:2.0:1788658303.142147:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658303.142162:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4f0e147/0xf657f176650ea7c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea7c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.142174:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4f0e147/0xf657f176650ea7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea7c0 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.142181:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4f0e147/0xf657f176650ea7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea7c0 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.142187:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4f0e147, rc 0) 00000100:00100000:2.0:1788658303.142227:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a7e55d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+7:5818:x1875544103715456:12345-0@lo:101: Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658303.142231:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658303.142302:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715456:0@lo:101: 00010000:00010000:0.0:1788658303.142311:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 0000000044464fd5/0xf657f176650ea7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.142318:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 0000000044464fd5/0xf657f176650ea7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658303.142327:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788658303.142341:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 0000000044464fd5/0xf657f176650ea7c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.142346:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 0000000044464fd5/0xf657f176650ea7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658303.142351:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788658303.142354:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658303.142358:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e56f44c2000 10000000:01000000:0.0:1788658303.142366:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788658303.142369:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788658303.142370:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788658303.142383:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000ea0c3bb7/0xf657f176650ea7ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.142389:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000ea0c3bb7/0xf657f176650ea7ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.142396:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000ea0c3bb7/0xf657f176650ea7ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.142406:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715584:0@lo:101: 00000100:00100000:0.0:1788658303.142430:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.142441:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e4479c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788658303.142496:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715584 00000100:00100000:2.0:1788658303.142501:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715584 00000100:00100000:2.0:1788658303.142527:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658303.142535:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b19b6477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+7:5818:x1875544103715584:12345-0@lo:101: 00010000:00010000:2.0:1788658303.142542:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658303.142549:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ecff2c6/0xf657f176650ea7d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea7ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.142561:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ecff2c6/0xf657f176650ea7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea7ce expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.142568:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ecff2c6/0xf657f176650ea7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea7ce expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.142574:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ecff2c6, rc 0) 00000100:00100000:2.0:1788658303.142609:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b19b6477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+8:5818:x1875544103715584:12345-0@lo:101: Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658303.142623:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658303.142695:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715584:0@lo:101: 00010000:00010000:0.0:1788658303.142704:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000ea0c3bb7/0xf657f176650ea7ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.142711:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000ea0c3bb7/0xf657f176650ea7ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.142747:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715712:0@lo:501: 00000100:00100000:0.0:1788658303.142771:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.142797:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e4479c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788658303.142896:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715712 00000100:00100000:2.0:1788658303.142900:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715712 00000100:00100000:2.0:1788658303.142916:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658303.142921:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca8943fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+8:5818:x1875544103715712:12345-0@lo:501: 00000100:00100000:2.0:1788658303.143193:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca8943fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+9:5818:x1875544103715712:12345-0@lo:501: Request processed in 271us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658303.143200:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658303.143308:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715712:0@lo:501: 00000100:00100000:0.0:1788658303.143335:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715840:0@lo:503: 00000100:00100000:0.0:1788658303.143371:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.143432:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e4479c6 going to sleep for 11 seconds 00000100:00100000:1.0:1788658303.143469:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715840 00000100:00100000:1.0:1788658303.143474:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715840 00000100:00100000:1.0:1788658303.143599:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658303.143606:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dacdb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+9:5818:x1875544103715840:12345-0@lo:503: 00000100:00100000:1.0:1788658303.143780:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dacdb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+9:5818:x1875544103715840:12345-0@lo:503: Request processed in 174us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658303.143787:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658303.143856:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103715840:0@lo:503: 00000100:00100000:3.0:1788658303.144203:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5860:1875544103715968:0@lo:502: 00000100:00100000:3.0:1788658303.144253:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658303.144414:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090b9df36 going to sleep for 11 seconds 00000100:00100000:2.0:1788658303.144449:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103715968 00000100:00100000:2.0:1788658303.144455:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103715968 00000100:00100000:0.0:1788658303.144494:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658303.144502:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d943b0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+9:5860:x1875544103715968:12345-0@lo:502: 00000100:00100000:0.0:1788658303.144689:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d943b0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+9:5860:x1875544103715968:12345-0@lo:502: Request processed in 187us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658303.144695:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658303.144836:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5860:1875544103715968:0@lo:502: 00000020:01000000:3.0:1788658303.144858:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658303.144870:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.144872:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788658303.144878:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788658303.144881:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658303.144900:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ce51612c) 00000020:00000080:3.0:1788658303.144926:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788658303.144933:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788658303.145049:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788658303.145057:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ea7e3 00000020:00000080:3.0:1788658303.145270:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788658303.145274:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658303.145278:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.145279:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788658303.145282:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658303.145285:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.145286:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788658303.145289:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658303.145295:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000adbbdfb6) 00000020:00000080:3.0:1788658303.145305:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788658303.145309:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788658303.145310:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788658303.145313:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788658303.145319:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788658303.145363:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b50a14b from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788658303.145374:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003629fb0b) 00000020:00000080:3.0:1788658303.145382:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788658303.145428:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788658303.145444:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ea7f8 00000020:00000080:3.0:1788658303.145556:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788658303.145562:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788658303.145572:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf657f176650ea7ff 00080000:01000000:3.0:1788658303.145578:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788658303.145586:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ea806 00080000:10000000:3.0:1788658303.146032:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788658303.146250:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788658303.150048:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788658303.197812:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788658303.198222:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788658303.200456:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788658303.201080:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788658303.227801:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c1bec7fd) 00000020:00000080:1.0:1788658303.227826:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788658303.227901:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788658303.227909:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ea814 00000020:00000080:2.0:1788658303.230061:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788658303.231228:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658303.267020:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.299193:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658303.330199:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.367028:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658303.401729:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788658303.426589:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf657f176650ea81b 00000020:00000080:3.0:1788658303.428538:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788658303.428553:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658303.428561:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.428563:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788658303.428567:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658303.428573:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.428574:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788658303.428579:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788658303.428626:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788658303.428642:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658303.428645:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.428646:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788658303.428648:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658303.428650:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.428651:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788658303.428654:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788658303.428656:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788658303.428724:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5860:1875544103716096:0@lo:502: 00000100:00100000:3.0:1788658303.428807:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658303.428950:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000683f03f6 going to sleep for 11 seconds 00000100:00100000:3.0:1788658303.428994:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716096 00000100:00100000:3.0:1788658303.429003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716096 00000100:00100000:3.0:1788658303.429055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658303.429062:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc622916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+9:5860:x1875544103716096:12345-0@lo:502: 00000100:00100000:3.0:1788658303.429519:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc622916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+9:5860:x1875544103716096:12345-0@lo:502: Request processed in 457us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658303.429541:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658303.429608:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5860:1875544103716096:0@lo:502: 00000020:01000000:3.0:1788658303.429634:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658303.429638:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658303.429640:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788658303.429643:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788658303.430795:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788658303.430822:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788658303.430846:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 00000000ea0c3bb7/0xf657f176650ea7ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.430857:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 00000000ea0c3bb7/0xf657f176650ea7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658303.430866:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56f44c2000 from 1 10000000:01000000:1.0:1788658303.430869:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658303.430922:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.430930:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.430939:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658303.430959:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe1b5dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716224:0@lo:101: 00000100:00100000:1.0:1788658303.431108:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658303.432544:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056e2cf57 going to sleep for 11 seconds 00000100:00100000:0.0:1788658303.432687:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716224 00000100:00100000:0.0:1788658303.432699:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716224 00000100:00100000:0.0:1788658303.432821:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788658303.432831:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000003f34dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+9:5818:x1875544103716224:12345-0@lo:101: 00010000:00010000:0.0:1788658303.432848:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658303.432867:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea822 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.432895:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea822 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.432906:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea822 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.432915:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbbdeb9c, rc 0) 00000100:00100000:0.0:1788658303.432985:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000003f34dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+10:5818:x1875544103716224:12345-0@lo:101: Request processed in 156us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658303.433020:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658303.433149:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe1b5dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716224:0@lo:101: 00010000:00010000:1.0:1788658303.433167:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.433175:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658303.433917:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe1b5dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716352:0@lo:256: 00000100:00100000:1.0:1788658303.433957:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658303.433991:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056e2cf57 going to sleep for 11 seconds 00000100:00100000:3.0:1788658303.433997:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716352 00000100:00100000:3.0:1788658303.434003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716352 00000100:00100000:3.0:1788658303.434045:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658303.434052:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9143ae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+10:5818:x1875544103716352:12345-0@lo:256: 20000000:01000000:3.0:1788658303.434069:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788658303.434075:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788658303.434143:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9143ae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+10:5818:x1875544103716352:12345-0@lo:256: Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658303.434150:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658303.434172:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe1b5dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716352:0@lo:256: 10000000:01000000:1.0:1788658303.435127:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658303.436139:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.436150:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658303.436157:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56f44c2000 from 1 10000000:01000000:1.0:1788658303.436158:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658303.436197:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.436203:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.436213:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658303.436258:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe1b5dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716480:0@lo:101: 00000100:00100000:1.0:1788658303.436312:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658303.436353:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716480 00000100:00100000:3.0:1788658303.436361:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716480 00000100:00100000:3.0:1788658303.436419:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658303.436428:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051059abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+10:5818:x1875544103716480:12345-0@lo:101: 00010000:00010000:3.0:1788658303.436440:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658303.436454:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea830 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.436476:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea830 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.436493:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea830 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.436501:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009bc133cf, rc 0) 00000100:00100000:0.0:1788658303.436749:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056e2cf57 going to sleep for 11 seconds 00000100:00100000:3.0:1788658303.436759:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051059abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:5818:x1875544103716480:12345-0@lo:101: Request processed in 333us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658303.436766:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658303.436773:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe1b5dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716480:0@lo:101: 00010000:00010000:0.0:1788658303.436787:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.436795:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.436856:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716608:0@lo:501: 00000100:00100000:0.0:1788658303.436884:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.436951:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e8058bb going to sleep for 11 seconds 00000100:00100000:1.0:1788658303.437106:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716608 00000100:00100000:1.0:1788658303.437111:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716608 00000100:00100000:1.0:1788658303.437143:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658303.437149:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0111c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+11:5818:x1875544103716608:12345-0@lo:501: 00000100:00100000:1.0:1788658303.439620:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0111c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+11:5818:x1875544103716608:12345-0@lo:501: Request processed in 2464us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658303.439635:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658303.439863:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716608:0@lo:501: 00000100:00100000:0.0:1788658303.439919:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716736:0@lo:503: 00000100:00100000:0.0:1788658303.439971:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.440246:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e8058bb going to sleep for 11 seconds 00000100:00100000:1.0:1788658303.440294:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716736 00000100:00100000:1.0:1788658303.440301:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716736 00000100:00100000:1.0:1788658303.440527:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658303.440537:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d42e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:5818:x1875544103716736:12345-0@lo:503: 00000040:00080000:1.0:1788658303.440724:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658303.440792:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d42e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:5818:x1875544103716736:12345-0@lo:503: Request processed in 256us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658303.440799:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658303.440865:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f98183 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716736:0@lo:503: 00000040:00080000:2.0:1788658303.441836:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788658303.442054:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788658303.442073:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658303.442125:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.442137:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658303.442180:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788658303.442183:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56f44c2000 10000000:01000000:3.0:1788658303.442186:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56f44c2000 10000000:01000000:3.0:1788658303.442189:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658303.442207:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56f44c2000 from 1 10000000:01000000:3.0:1788658303.442210:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788658303.442257:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 0000000067631f4f/0xf657f176650ea83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.442266:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 0000000067631f4f/0xf657f176650ea83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.442290:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 0000000067631f4f/0xf657f176650ea83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658303.442317:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716864:0@lo:101: 00000100:00100000:3.0:1788658303.442376:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658303.442417:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ed0174c going to sleep for 11 seconds 00000100:00100000:1.0:1788658303.442469:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716864 00000100:00100000:1.0:1788658303.442477:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716864 00000100:00100000:1.0:1788658303.442518:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658303.442527:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ea1789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+11:5818:x1875544103716864:12345-0@lo:101: 00010000:00010000:1.0:1788658303.442549:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658303.442570:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f53b64f9/0xf657f176650ea845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea83e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.442594:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f53b64f9/0xf657f176650ea845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea83e expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.442611:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f53b64f9/0xf657f176650ea845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea83e expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658303.442620:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f53b64f9, rc 0) 00000100:00100000:1.0:1788658303.442693:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ea1789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:5818:x1875544103716864:12345-0@lo:101: Request processed in 167us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658303.442700:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658303.442823:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716864:0@lo:101: 00010000:00010000:3.0:1788658303.442838:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 0000000067631f4f/0xf657f176650ea83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.442846:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 0000000067631f4f/0xf657f176650ea83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658303.442891:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716992:0@lo:501: 00000100:00100000:3.0:1788658303.442915:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658303.442940:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ed0174c going to sleep for 11 seconds 00000100:00100000:0.0:1788658303.443012:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103716992 00000100:00100000:0.0:1788658303.443016:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103716992 00000100:00100000:0.0:1788658303.443043:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658303.443048:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000420485d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5818:x1875544103716992:12345-0@lo:501: 00000100:00100000:0.0:1788658303.443320:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000420485d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5818:x1875544103716992:12345-0@lo:501: Request processed in 272us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658303.443327:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658303.443393:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103716992:0@lo:501: 00000100:00100000:3.0:1788658303.443418:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103717120:0@lo:503: 00000100:00100000:3.0:1788658303.443457:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658303.443476:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ed0174c going to sleep for 11 seconds 00000100:00100000:0.0:1788658303.443531:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103717120 00000100:00100000:0.0:1788658303.443535:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103717120 00000100:00100000:0.0:1788658303.443573:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658303.443585:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067a290d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5818:x1875544103717120:12345-0@lo:503: 00000100:00100000:0.0:1788658303.443894:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067a290d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5818:x1875544103717120:12345-0@lo:503: Request processed in 310us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658303.443901:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658303.444018:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103717120:0@lo:503: 00000100:00100000:1.0:1788658303.444737:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c4588fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5865:1875544103717248:0@lo:502: 00000100:00100000:1.0:1788658303.444791:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658303.444821:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c7f39bc going to sleep for 11 seconds 00000100:00100000:0.0:1788658303.444928:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103717248 00000100:00100000:0.0:1788658303.444936:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103717248 00000100:00100000:0.0:1788658303.444975:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658303.444983:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2e72b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5865:x1875544103717248:12345-0@lo:502: 00000100:00100000:0.0:1788658303.445209:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2e72b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5865:x1875544103717248:12345-0@lo:502: Request processed in 228us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658303.445227:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658303.445338:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c4588fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5865:1875544103717248:0@lo:502: 00000020:01000004:1.0:1788658303.445402:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788658303.445419:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002feb4c29) 00000020:00000080:1.0:1788658303.445441:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788658303.445540:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b50a14b from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788658303.445545:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006b50a14b from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788658303.445547:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006b50a14b 4 00010000:00080000:1.0:1788658303.445644:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006dbdbf50@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:0.0:1788658303.448084:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788658303.448295:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788658303.448331:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658303.448343:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf657f176650ea853 00000100:00080000:0.0:1788658303.448356:0:5865:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658303.448363:0:5865:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006dbdbf50 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1788658303.448404:0:5865:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004fa0815f x1875544103717376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658303.448474:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fa0815f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103717376:0@lo:38: 00000100:00100000:1.0:1788658303.448562:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658303.450463:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788658303.450759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103717376 00000100:00100000:0.0:1788658303.450771:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103717376 00000100:00100000:0.0:1788658303.450815:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658303.450824:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c4588fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103717376:12345-0@lo:38: 00000100:00100000:2.0:1788658303.452970:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007da3fdae pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5865:1875544103717504:0@lo:502: 00000100:00100000:2.0:1788658303.453056:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658303.453109:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032b51d94 going to sleep for 11 seconds 00000100:00100000:1.0:1788658303.453272:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103717504 00000100:00100000:1.0:1788658303.453282:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103717504 00000100:00100000:1.0:1788658303.453339:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658303.453348:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000858b8738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:5865:x1875544103717504:12345-0@lo:502: 00000100:00100000:1.0:1788658303.453701:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000858b8738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:5865:x1875544103717504:12345-0@lo:502: Request processed in 354us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658303.453719:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658303.460396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c4588fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103717376:12345-0@lo:38: Request processed in 9563us (11824us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788658303.460413:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658303.460584:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658303.460597:0:3303:0:(import.c:65:import_set_state_nolock()) 000000006dbdbf50 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658303.460603:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788658303.460607:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fa0815f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103717376:0@lo:38: 00000100:00100000:1.0:1788658303.460689:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007da3fdae pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:5865:1875544103717504:0@lo:502: 00000040:00080000:1.0:1788658303.460728:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788658303.460946:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788658303.460970:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658303.460995:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 0000000067631f4f/0xf657f176650ea83e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.461006:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 0000000067631f4f/0xf657f176650ea83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788658303.461054:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788658303.461057:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658303.461058:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658303.461059:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658303.461061:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658303.461062:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658303.461063:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658303.461065:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658303.461067:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658303.461068:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658303.461070:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658303.461071:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788658303.461076:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788658303.461078:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658303.461080:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658303.461080:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658303.461081:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658303.461082:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658303.461083:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658303.461084:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658303.461085:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658303.461086:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658303.461087:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658303.461088:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658303.461089:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788658303.461119:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788658303.461139:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103717632:0@lo:253: 00000100:00100000:0.0:1788658303.461213:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.461263:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bef67ba going to sleep for 11 seconds 00000100:00100000:3.0:1788658303.462021:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103717632 00000100:00100000:3.0:1788658303.462031:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103717632 00000100:00100000:3.0:1788658303.462179:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658303.462189:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe2b80c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:5818:x1875544103717632:12345-0@lo:253: 20000000:01000000:3.0:1788658303.462236:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788658303.462250:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788658303.484353:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658303.484406:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788658303.486714:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788658303.486724:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788658303.486746:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.486766:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea822 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.486774:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.486820:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea822 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.486836:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea822 expref: 12 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.486851:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000300b7c62 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875544103717760:0@lo:104: 00000100:00100000:0.0:1788658303.486927:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658303.486983:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee489eee going to sleep for 11 seconds 00000100:00100000:3.0:1788658303.487133:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103717760 00000100:00100000:3.0:1788658303.487142:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103717760 00000100:00100000:3.0:1788658303.487206:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658303.487216:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d016053e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:5853:x1875544103717760:12345-0@lo:104: 00010000:00010000:3.0:1788658303.487238:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.487298:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788658303.487304:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d016053e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:5853:x1875544103717760:12345-0@lo:104: Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658303.487311:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788658303.487333:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658303.487338:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.487345:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000039febab6 already unused, calling callback (0000000079adb242) 10000000:00010000:3.0:1788658303.487347:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.487355:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658303.487361:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658303.487366:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658303.487410:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.487417:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658303.487434:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.487439:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: 0000000039febab6/0xf657f176650ea822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea829 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658303.487455:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658303.487456:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658303.487458:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658303.487517:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103717888:0@lo:103: 00000100:00100000:3.0:1788658303.487692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658303.487797:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103717888 00000100:00100000:2.0:1788658303.487803:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103717888 00010000:00010000:2.0:1788658303.487822:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea822 expref: 13 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658303.487851:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658303.487857:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ad2ab7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+13:3305:x1875544103717888:12345-0@lo:103: 00010000:00010000:2.0:1788658303.487867:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658303.487877:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea822 expref: 13 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487887:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea822 expref: 13 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487903:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487911:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788658303.487924:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001201725s 00010000:00010000:2.0:1788658303.487928:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487934:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487939:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487943:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487948:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000688d4fbb already unused, calling callback (00000000367121a8) 00010000:00010000:2.0:1788658303.487952:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487958:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487965:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658303.487980:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658303.488011:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ad2ab7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+13:3305:x1875544103717888:12345-0@lo:103: Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658303.488018:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658303.488093:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103717888:0@lo:103: 00010000:00010000:0.0:1788658303.488165:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbbdeb9c/0xf657f176650ea829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea822 expref: 12 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658303.488176:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000300b7c62 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875544103717760:0@lo:104: 00010000:00010000:0.0:1788658303.488190:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.488198:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.488202:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658303.488216:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000688d4fbb/0xf657f176650ea85a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658303.493331:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe2b80c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+11:5818:x1875544103717632:12345-0@lo:253: Request processed in 31135us (32111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658303.493350:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658303.493592:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:5818:1875544103717632:0@lo:253: 10000000:01000000:0.0:1788658303.493612:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788658303.493616:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658303.493618:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658303.493619:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658303.493620:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658303.493622:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658303.493623:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658303.493625:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658303.493626:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658303.493628:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658303.493629:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658303.493631:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658303.493632:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788658303.493647:0:5818:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788658303.499078:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.499518:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658303.499852:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.500043:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658303.500245:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.500411:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658303.501302:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.501507:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658303.501801:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.501984:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658303.502197:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658303.502395:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788658303.538867:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788658303.568637:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788658303.568942:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788658303.571439:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788658303.571610:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788658303.572028:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788658303.572036:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788658303.572204:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658303.573136:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788658303.573962:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788658303.574860:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788658303.575263:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788658303.575507:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00000020:00080000:1.0:1788658303.576468:0:5870:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788658303.576473:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00100000:10000000:3.0:1788658303.576787:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788658303.576942:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788658303.577090:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788658303.577222:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788658303.577378:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788658303.577520:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788658303.577692:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788658303.577843:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788658303.577981:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788658303.578120:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788658303.583820:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788658303.584935:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788658303.585315:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788658303.585543:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788658303.585751:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788658303.585909:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788658303.586657:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788658303.586922:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788658303.587075:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788658303.587222:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788658303.587761:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788658303.587915:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788658303.588082:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788658303.588254:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788658303.588752:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788658303.588929:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788658303.589096:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788658303.589260:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788658303.589498:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788658303.589769:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788658303.589914:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788658303.590070:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788658303.590293:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788658303.621338:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788658303.664001:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788658303.664054:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdf241c4b988 00100000:10000000:0.0:1788658303.664064:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788658303.669268:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658303.669288:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658303.669300:0:5818:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788658303.669318:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788658303.715713:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658303.716314:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788658303.716390:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788658303.716395:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788658304.735492:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658305.759757:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658306.780918:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658307.805905:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658307.938820:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788658308.508841:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658308.508850:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56f44c2000 from 3 10000000:01000000:3.0:1788658308.508855:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658308.508904:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000babe0c2d/0xf657f176650ea861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658308.508917:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000babe0c2d/0xf657f176650ea861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658308.508928:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000babe0c2d/0xf657f176650ea861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658308.508956:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103718016:0@lo:101: 00000100:00100000:3.0:1788658308.509028:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658308.509077:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a92262af going to sleep for 11 seconds 00000100:00100000:2.0:1788658308.509208:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718016 00000100:00100000:2.0:1788658308.509219:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718016 00000100:00100000:2.0:1788658308.509270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788658308.509293:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093f32645 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:5834:x1875544103718016:12345-0@lo:101: 00010000:00010000:2.0:1788658308.509307:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658308.509323:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035ab002a/0xf657f176650ea868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea861 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658308.509349:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035ab002a/0xf657f176650ea868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea861 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788658308.509571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788658308.509576:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788658308.509580:0:36:0:(import.c:65:import_set_state_nolock()) 000000006dbdbf50 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658308.509589:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006dbdbf50 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658308.509616:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000080c5ebc3 x1875544103718144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658308.509647:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080c5ebc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103718144:0@lo:38: 00000100:00100000:1.0:1788658308.509711:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658308.510572:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035ab002a/0xf657f176650ea868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea861 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658308.510585:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035ab002a, rc 0) 00000100:00100000:2.0:1788658308.516911:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093f32645 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103718016:12345-0@lo:101: Request processed in 7611us (7874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658308.516925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658308.517108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718144 00000100:00100000:1.0:1788658308.517119:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718144 00000100:00100000:1.0:1788658308.517165:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658308.517173:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014724ca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875544103718144:12345-0@lo:38: 00010000:00080000:1.0:1788658308.517294:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788658308.517335:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf657f176650ea86f 00000004:00100000:1.0:1788658308.518838:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788658308.518972:0:5839:0:(import.c:65:import_set_state_nolock()) 0000000008c2ab7a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658308.519058:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014724ca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875544103718144:12345-0@lo:38: Request processed in 1884us (9345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658308.519069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788658308.519143:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000080c5ebc3 x1875544103718144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788658308.519162:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788658308.519171:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788658308.519176:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658308.519179:0:3303:0:(import.c:65:import_set_state_nolock()) 000000006dbdbf50 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658308.519185:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080c5ebc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103718144:0@lo:38: 00000100:00100000:3.0:1788658308.524324:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103718016:0@lo:101: 00010000:00010000:3.0:1788658308.524491:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000babe0c2d/0xf657f176650ea861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658308.524516:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000babe0c2d/0xf657f176650ea861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658308.525287:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103718272:0@lo:256: 00000100:00100000:3.0:1788658308.525967:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658308.526022:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a92262af going to sleep for 11 seconds 00000100:00100000:2.0:1788658308.526296:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718272 00000100:00100000:2.0:1788658308.526309:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718272 00000100:00100000:3.0:1788658308.526517:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658308.526529:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abcccd11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103718272:12345-0@lo:256: 20000000:01000000:3.0:1788658308.526558:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658308.526576:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658308.526579:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788658308.527558:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468f7767 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103718272:0@lo:256: 10000000:01000000:1.0:1788658308.527619:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658308.527628:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 00000000babe0c2d/0xf657f176650ea861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658308.527639:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 00000000babe0c2d/0xf657f176650ea861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658308.527937:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abcccd11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103718272:12345-0@lo:256: Request processed in 1409us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658308.527948:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788658308.832324:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658309.852976:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658310.877129:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658311.904456:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788658312.661335:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef0265410 20000000:00000080:3.0:1788658312.661483:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5701bb0c00 uarg=0000000000000000 20000000:01000000:3.0:1788658312.661522:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788658312.661529:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788658312.661535:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788658312.661973:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788658312.661986:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788658312.667717:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658312.668182:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788658312.668250:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788658312.668299:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788658312.668318:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788658312.668339:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658312.668482:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea830 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658312.668489:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658312.668535:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea830 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658312.668551:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea830 expref: 11 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658312.668569:0:6316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be05aa2b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875544103718400:0@lo:104: 00000100:00100000:3.0:1788658312.668652:0:6316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658312.668794:0:6316:0:(client.c:2716:ptlrpc_set_wait()) set 000000008633c3f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788658312.669600:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718400 00000100:00100000:2.0:1788658312.669612:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718400 00000100:00100000:2.0:1788658312.669909:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658312.669919:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d99b66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:6316:x1875544103718400:12345-0@lo:104: 00010000:00010000:2.0:1788658312.669937:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658312.670036:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658312.670042:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d99b66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:6316:x1875544103718400:12345-0@lo:104: Request processed in 126us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.670058:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658312.670282:0:6316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be05aa2b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875544103718400:0@lo:104: 00010000:00010000:0.0:1788658312.670310:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.670516:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658312.670523:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.670542:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005cebfdbd already unused, calling callback (0000000079adb242) 10000000:00010000:1.0:1788658312.670545:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.670553:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658312.670560:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658312.670565:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658312.670611:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.670618:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658312.670642:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.670649:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: 000000005cebfdbd/0xf657f176650ea830 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea837 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.670685:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658312.670687:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658312.670689:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658312.671041:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080c5ebc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103718528:0@lo:103: 00000100:00100000:3.0:1788658312.671176:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658312.671527:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718528 00000100:00100000:0.0:1788658312.671535:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718528 00010000:00010000:0.0:1788658312.671563:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea830 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658312.671638:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658312.671656:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080b064f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+12:3306:x1875544103718528:12345-0@lo:103: 00010000:00010000:0.0:1788658312.671696:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658312.671702:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea830 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671713:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea830 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671726:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009bc133cf/0xf657f176650ea837 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea830 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671740:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671748:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671763:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671770:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671776:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671782:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671787:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087edb638 already unused, calling callback (00000000367121a8) 00010000:00010000:0.0:1788658312.671790:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671803:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671822:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658312.671832:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658312.671879:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080b064f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+11:3306:x1875544103718528:12345-0@lo:103: Request processed in 225us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658312.671895:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658312.671964:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080c5ebc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103718528:0@lo:103: 00010000:00010000:1.0:1788658312.672123:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.672131:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658312.672147:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087edb638/0xf657f176650ea876 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658312.927947:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658313.631019:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad0fc9b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103718656:0@lo:400: 00000100:00100000:0.0:1788658313.631103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658313.631199:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718656 00000100:00100000:1.0:1788658313.631219:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718656 00000100:00100000:1.0:1788658313.631279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788658313.631288:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e05dc9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:3307:x1875544103718656:12345-0@lo:400: 00000100:00100000:2.0:1788658313.633060:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a6bd2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103718784:0@lo:400: 00000100:00100000:2.0:1788658313.633124:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658313.634067:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718784 00000100:00100000:2.0:1788658313.634081:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718784 00000100:00100000:2.0:1788658313.634138:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658313.634146:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c2b4a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103718784:12345-0@lo:400: 00000100:00100000:2.0:1788658313.634220:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c2b4a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103718784:12345-0@lo:400: Request processed in 74us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658313.634228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788658313.634282:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006a6bd2f0 x1875544103718784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658313.634298:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a6bd2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103718784:0@lo:400: 00000100:00100000:1.0:1788658313.641137:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e05dc9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:3307:x1875544103718656:12345-0@lo:400: Request processed in 9838us (10023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658313.641156:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658313.643206:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad0fc9b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103718656:0@lo:400: 00010000:00010000:1.0:1788658313.948865:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788658314.461131:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658314.461144:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56f44c2000 from 1 10000000:01000000:0.0:1788658314.461152:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658314.461210:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000688d4fbb/0xf657f176650ea87d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.461225:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000688d4fbb/0xf657f176650ea87d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.461237:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000688d4fbb/0xf657f176650ea87d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658314.461264:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103718912:0@lo:101: 00000100:00100000:0.0:1788658314.461356:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.461413:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000629585c4 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.465571:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103718912 00000100:00100000:3.0:1788658314.465593:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103718912 00000100:00100000:3.0:1788658314.465774:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658314.465785:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cebf129e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:5834:x1875544103718912:12345-0@lo:101: 00010000:00010000:3.0:1788658314.465812:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658314.465840:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006cf1fa2f/0xf657f176650ea884 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea87d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.465875:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006cf1fa2f/0xf657f176650ea884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea87d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.465887:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006cf1fa2f/0xf657f176650ea884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea87d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.465913:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006cf1fa2f, rc 0) 00000100:00100000:3.0:1788658314.466027:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cebf129e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103718912:12345-0@lo:101: Request processed in 244us (4672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.466034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658314.466148:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103718912:0@lo:101: 00010000:00010000:0.0:1788658314.466170:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000688d4fbb/0xf657f176650ea87d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.466180:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000688d4fbb/0xf657f176650ea87d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658314.466258:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103719040:0@lo:501: 00000100:00100000:0.0:1788658314.466290:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.470746:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000629585c4 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.471124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719040 00000100:00100000:1.0:1788658314.471135:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719040 00000100:00100000:1.0:1788658314.471198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658314.471208:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d7e4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103719040:12345-0@lo:501: 00000100:00100000:1.0:1788658314.471776:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d7e4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103719040:12345-0@lo:501: Request processed in 567us (5483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.471786:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658314.471910:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103719040:0@lo:501: 00000100:00100000:0.0:1788658314.472050:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103719168:0@lo:503: 00000100:00100000:0.0:1788658314.472107:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.472145:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000629585c4 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.472208:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719168 00000100:00100000:1.0:1788658314.472214:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719168 00000100:00100000:1.0:1788658314.472242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658314.472249:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f51f447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103719168:12345-0@lo:503: 00000100:00100000:1.0:1788658314.472791:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f51f447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103719168:12345-0@lo:503: Request processed in 541us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.472799:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658314.473160:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f80eafb9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103719168:0@lo:503: 00000100:00100000:3.0:1788658314.474591:0:6384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000051147eeb pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6384:1875544103719296:0@lo:502: 00000100:00100000:3.0:1788658314.474768:0:6384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.474862:0:6384:0:(client.c:2716:ptlrpc_set_wait()) set 000000006084c374 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.474916:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719296 00000100:00100000:1.0:1788658314.474932:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719296 00000100:00100000:1.0:1788658314.475097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658314.475107:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f08115ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:6384:x1875544103719296:12345-0@lo:502: 00000100:00100000:1.0:1788658314.475364:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f08115ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:6384:x1875544103719296:12345-0@lo:502: Request processed in 259us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.475373:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658314.475487:0:6384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000051147eeb pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6384:1875544103719296:0@lo:502: 00000020:01000000:0.0:1788658314.475522:0:6384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658314.475534:0:6384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658314.475537:0:6384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788658314.475545:0:6384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56f44c2000 00000020:00000080:0.0:1788658314.475548:0:6384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788658314.475600:0:6384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6384:1875544103719424:0@lo:502: 00000100:00100000:0.0:1788658314.475640:0:6384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.476100:0:6384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6fb06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.476181:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719424 00000100:00100000:3.0:1788658314.476187:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719424 00000100:00100000:3.0:1788658314.476224:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658314.476231:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6384:x1875544103719424:12345-0@lo:502: 00000100:00100000:3.0:1788658314.476417:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6384:x1875544103719424:12345-0@lo:502: Request processed in 185us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.476550:0:6384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6384:1875544103719424:0@lo:502: 00000020:01000000:0.0:1788658314.476577:0:6384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658314.476588:0:6384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658314.476590:0:6384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788658314.476594:0:6384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788658314.476711:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788658314.476735:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658314.476749:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.476762:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.476949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788658314.972861:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658315.997860:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658317.022179:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658318.048964:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658318.749828:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658318.749855:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103719552:0@lo:400: 00000100:00100000:2.0:1788658318.749937:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658318.749997:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103719680:0@lo:400: 00000100:00100000:2.0:1788658318.750025:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658318.750059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719552 00000100:00100000:2.0:1788658318.750068:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719552 00000100:00100000:2.0:1788658318.750130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658318.750139:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:3304:x1875544103719552:12345-0@lo:400: 00000100:00100000:2.0:1788658318.750196:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:3304:x1875544103719552:12345-0@lo:400: Request processed in 57us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658318.750204:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658318.750245:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719680 00000100:00100000:2.0:1788658318.750250:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719680 00000100:00100000:2.0:1788658318.750283:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658318.750289:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103719680:12345-0@lo:400: 00000100:00100000:2.0:1788658318.750344:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103719680:12345-0@lo:400: Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658318.750351:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658318.750392:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103719552:0@lo:400: 00010000:00080000:0.0:1788658318.750407:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e56c5733b80 x1875544103719680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658318.750423:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103719680:0@lo:400: 00010000:00010000:2.0:1788658319.070911:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788658319.155009:0:6682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788658319.155014:0:6682:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788658319.155142:0:6682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e57014ee800 00000020:01000004:2.0:1788658319.155159:0:6682:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788658319.155171:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788658319.155185:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e56c56c3380) 00000020:00000080:2.0:1788658319.155204:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788658319.171900:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788658319.172282:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788658319.191911:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788658319.197592:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788658319.197630:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788658319.197767:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788658319.197803:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788658319.198255:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788658319.198267:0:6682:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788658319.198279:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf657f176650ea892 00000020:01000004:3.0:1788658319.198288:0:6682:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788658319.198313:0:6682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788658319.198322:0:6682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788658319.198327:0:6682:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788658319.198333:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788658319.198344:0:6682:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e56fb3b99c0) 00000020:00000080:3.0:1788658319.198355:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788658319.204748:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658319.204965:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658319.204974:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788658319.206318:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658319.206328:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788658319.206912:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658319.206920:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788658319.209020:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658319.209274:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788658319.209281:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788658319.212880:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788658319.212891:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788658319.241037:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658319.241340:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788658319.241348:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788658319.242472:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788658319.242481:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788658319.244012:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658319.244025:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788658319.246211:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658319.246392:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788658319.246398:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788658319.248035:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788658319.248047:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788658319.292120:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658319.292324:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788658319.292329:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788658319.293008:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788658319.293016:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788658319.293452:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788658319.293472:0:6682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788658319.293479:0:6682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788658319.304897:0:6682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658319.304931:0:6682:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788658319.304934:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658319.304935:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658319.304936:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658319.304937:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658319.304938:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658319.304939:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658319.304940:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658319.304941:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658319.304944:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658319.304945:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658319.304947:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658319.304951:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788658319.304952:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658319.304953:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658319.304953:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658319.304954:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658319.304955:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658319.304956:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658319.304957:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658319.304958:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658319.304958:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658319.304959:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658319.304960:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658319.305000:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788658319.305027:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103719808:0@lo:253: 00000100:00100000:0.0:1788658319.305097:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.305156:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.305198:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719808 00000100:00100000:2.0:1788658319.305208:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719808 00000100:00100000:2.0:1788658319.305262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788658319.305272:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103719808:12345-0@lo:253: 20000000:01000000:2.0:1788658319.305304:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788658319.305309:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788658319.305314:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788658319.305319:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788658319.306364:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658319.306594:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788658319.306610:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788658319.306647:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788658319.306655:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788658319.306715:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788658319.306767:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788658319.307163:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788658319.307186:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:2.0:1788658319.307189:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788658319.307222:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788658319.307232:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788658319.307276:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788658319.307284:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:2.0:1788658319.307315:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788658319.307325:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788658319.307354:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788658319.307404:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788658319.308121:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788658319.308139:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:2.0:1788658319.308141:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788658319.308175:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788658319.308189:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788658319.308217:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788658319.308224:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:2.0:1788658319.308267:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788658319.308276:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788658319.308306:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788658319.308340:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788658319.308355:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788658319.308358:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788658319.308362:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788658319.308375:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788658319.308378:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788658319.308410:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788658319.308412:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788658319.310482:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788658319.310609:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788658319.310661:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788658319.311420:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788658319.311464:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788658319.311497:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788658319.311509:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788658319.311511:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788658319.312274:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788658319.312322:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788658319.312375:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788658319.312599:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788658319.312638:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788658319.312721:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788658319.312736:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788658319.312738:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788658319.313477:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788658319.313829:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788658319.313866:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788658319.313906:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788658319.313921:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788658319.313925:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788658319.313935:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788658319.314111:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314137:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea7b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314143:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea7ce expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314147:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c1679200/0xf657f176650ea845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea83e expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314152:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314191:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c1679200/0xf657f176650ea845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea83e expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314201:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c1679200/0xf657f176650ea845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea83e expref: 12 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658319.314215:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875544103719936:0@lo:104: 00000100:00100000:2.0:1788658319.314272:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658319.314322:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea7ce expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314329:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea7d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea7ce expref: 12 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.314334:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103719936 00000100:00100000:2.0:1788658319.314337:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875544103720064:0@lo:104: 00000100:00100000:0.0:1788658319.314342:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103719936 00000100:00100000:2.0:1788658319.314356:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.314380:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720064 00000100:00100000:0.0:1788658319.314383:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720064 00010000:00010000:2.0:1788658319.314387:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea7b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.314398:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788658319.314400:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea7b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 12 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.314406:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5830:x1875544103719936:12345-0@lo:104: 00000100:00100000:2.0:1788658319.314408:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875544103720192:0@lo:104: 00010000:00010000:0.0:1788658319.314419:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658319.314427:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.314437:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f44eb300 going to sleep for 11 seconds 00010000:00010000:0.0:1788658319.314469:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658319.314476:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5830:x1875544103719936:12345-0@lo:104: Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.314482:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658319.314489:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875544103719936:0@lo:104: 00000100:00100000:0.0:1788658319.314497:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720192 00000100:00100000:0.0:1788658319.314500:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720192 00000100:00100000:0.0:1788658319.314520:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658319.314526:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5830:x1875544103720064:12345-0@lo:104: 00010000:00010000:0.0:1788658319.314533:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.314573:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658319.314578:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5830:x1875544103720064:12345-0@lo:104: Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.314584:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658319.314596:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658319.314602:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:5830:x1875544103720192:12345-0@lo:104: 00010000:00010000:0.0:1788658319.314609:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.314635:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788658319.314641:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:5830:x1875544103720192:12345-0@lo:104: Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.314646:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788658319.314783:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788658319.314788:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314803:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658319.314807:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314817:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658319.314824:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658319.314830:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658319.314867:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314873:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658319.314899:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314916:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57021d9200/0xf657f176650ea83e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea845 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314929:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658319.314932:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314937:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0031000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658319.314940:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.314946:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658319.314953:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658319.315032:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658319.315047:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315054:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658319.315069:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315076:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0031000/0xf657f176650ea7ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea7d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315085:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658319.315096:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315168:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0030000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658319.315172:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315179:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658319.315185:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658319.315189:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658319.315204:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315210:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658319.315215:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315221:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0030000/0xf657f176650ea7b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea7b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.315235:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658319.315237:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658319.315238:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658319.315250:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658319.315262:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103720320:0@lo:103: 00000100:00100000:2.0:1788658319.315294:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.315376:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103720576:0@lo:103: 00000100:00100000:2.0:1788658319.315465:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103720448:0@lo:103: 00000100:00100000:2.0:1788658319.315492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658319.315691:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658319.315852:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875544103720064:0@lo:104: 00000100:00100000:3.0:1788658319.315860:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875544103720192:0@lo:104: 00010000:00010000:3.0:1788658319.315885:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.316058:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720320 00000100:00100000:0.0:1788658319.316065:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720320 00010000:00010000:0.0:1788658319.316090:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c1679200/0xf657f176650ea845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea83e expref: 13 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658319.316192:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.316340:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720448 00000100:00100000:1.0:1788658319.316344:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720448 00010000:00010000:1.0:1788658319.316360:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea7d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea7ce expref: 14 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658319.316372:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720576 00000100:00100000:1.0:1788658319.316374:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720576 00010000:00010000:1.0:1788658319.316381:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea7b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 15 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658319.316394:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658319.316400:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+15:3306:x1875544103720320:12345-0@lo:103: 00010000:00010000:1.0:1788658319.316421:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658319.316426:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c1679200/0xf657f176650ea845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea83e expref: 15 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316437:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c1679200/0xf657f176650ea845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea83e expref: 15 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316450:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679200/0xf657f176650ea845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea83e expref: 15 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316463:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658319.316516:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+14:3306:x1875544103720320:12345-0@lo:103: Request processed in 115us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658319.316522:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658319.316536:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658319.316542:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+13:3304:x1875544103720448:12345-0@lo:103: 00010000:00010000:1.0:1788658319.316548:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658319.316552:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea7d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea7ce expref: 13 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316560:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea7ce expref: 13 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316578:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea7d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea7ce expref: 13 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316587:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658319.316681:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103720320:0@lo:103: 00000100:00100000:1.0:1788658319.316872:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+12:3304:x1875544103720448:12345-0@lo:103: Request processed in 329us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658319.316890:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658319.316906:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658319.316911:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+11:3305:x1875544103720576:12345-0@lo:103: 00010000:00010000:1.0:1788658319.316918:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658319.316922:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea7b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 11 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316932:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea7b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 11 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316942:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea7b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea7b2 expref: 11 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316952:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316971:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316985:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.316993:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.317001:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.317007:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.317021:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfa00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658319.317026:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.317036:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.317053:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.317063:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658319.317090:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+10:3305:x1875544103720576:12345-0@lo:103: Request processed in 179us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658319.317096:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788658319.317185:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.317194:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.317200:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788658319.317215:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788658319.317370:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103720448:0@lo:103: 00000100:00100000:3.0:1788658319.317393:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103720576:0@lo:103: 00000100:00100000:2.0:1788658319.362924:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+9:6682:x1875544103719808:12345-0@lo:253: Request processed in 57646us (57818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.362938:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658319.363155:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103719808:0@lo:253: 10000000:01000000:0.0:1788658319.363175:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788658319.363178:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658319.363179:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658319.363180:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658319.363181:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788658319.363194:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658319.363195:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658319.363197:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658319.363198:0:6682:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788658319.363199:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658319.363200:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788658319.363222:0:6682:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e57014ee800 from lustre-OST0000 10000000:01000000:0.0:1788658319.363243:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788658319.363245:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788658319.363253:0:6682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e56c56c19c0 local copy 10000000:01000000:0.0:1788658319.363257:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788658319.363292:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.363301:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.363308:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.363325:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103720704:0@lo:101: 00000100:00100000:0.0:1788658319.363354:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.363428:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.363488:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720704 00000100:00100000:2.0:1788658319.363494:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720704 00000100:00100000:2.0:1788658319.363655:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788658319.363662:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+9:6682:x1875544103720704:12345-0@lo:101: 00010000:00010000:2.0:1788658319.363696:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658319.363709:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea8a7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.363730:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea8a7 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.363741:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8a7 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.363751:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dfa00, rc 0) 00000100:00100000:2.0:1788658319.363791:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+10:6682:x1875544103720704:12345-0@lo:101: Request processed in 129us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.363809:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658319.363873:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103720704:0@lo:101: 00010000:00010000:0.0:1788658319.363887:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.363896:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.363993:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103720832:0@lo:501: 00000100:00100000:0.0:1788658319.364019:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.364132:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658319.364264:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720832 00000100:00100000:3.0:1788658319.364269:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720832 00000100:00100000:3.0:1788658319.364294:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658319.364301:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+10:6682:x1875544103720832:12345-0@lo:501: 00000100:00100000:3.0:1788658319.364531:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+10:6682:x1875544103720832:12345-0@lo:501: Request processed in 230us (511us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658319.364539:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658319.364752:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103720832:0@lo:501: 10000000:01000000:0.0:1788658319.364767:0:6682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788658319.364805:0:6682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788658319.364811:0:6682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.364821:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.364828:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.364854:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788658319.364872:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e57014ee800 10000000:01000000:0.0:1788658319.364877:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788658319.364882:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e56c56c19c0 10000000:01000000:0.0:1788658319.364884:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788658319.364888:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e56c56c19c0 from 1 10000000:01000000:0.0:1788658319.364890:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788658319.364912:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.364919:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.364928:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.364942:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103720960:0@lo:101: 00000100:00100000:0.0:1788658319.364979:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.365000:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.365065:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103720960 00000100:00100000:2.0:1788658319.365071:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103720960 00000100:00100000:2.0:1788658319.365095:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658319.365113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+10:6682:x1875544103720960:12345-0@lo:101: 00010000:00010000:2.0:1788658319.365121:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658319.365136:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dfc00/0xf657f176650ea8bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea8b5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.365154:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dfc00/0xf657f176650ea8bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea8b5 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.365164:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dfc00/0xf657f176650ea8bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8b5 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.365172:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dfc00, rc 0) 00000100:00100000:2.0:1788658319.365202:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103720960:12345-0@lo:101: Request processed in 99us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.365208:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788658319.365343:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103720960:0@lo:101: 00010000:00010000:0.0:1788658319.365354:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.365363:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea8bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658319.365378:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788658319.365396:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.365403:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658319.365409:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788658319.365413:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658319.365416:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788658319.365418:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788658319.365431:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.365438:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.365445:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.365455:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721088:0@lo:101: 00000100:00100000:0.0:1788658319.365487:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.365499:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00010000:00010000:3.0:1788658319.365686:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658319.365694:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365701:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0030a00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658319.365705:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365714:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658319.365721:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658319.365728:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658319.365749:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365755:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658319.365784:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365792:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf657f176650ea8ae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365816:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658319.365818:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658319.365825:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658319.365834:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658319.365845:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103721216:0@lo:103: 00000100:00100000:3.0:1788658319.365875:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658319.365908:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721088 00000100:00100000:3.0:1788658319.365913:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721088 00000100:00100000:3.0:1788658319.365934:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658319.365940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721088:12345-0@lo:101: 00010000:00010000:3.0:1788658319.365947:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658319.365957:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea8c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365971:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365979:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.365986:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9600, rc 0) 00000100:00100000:3.0:1788658319.366011:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103721088:12345-0@lo:101: Request processed in 71us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.366016:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658319.366041:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721216 00000100:00100000:3.0:1788658319.366044:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721216 00000100:00100000:3.0:1788658319.366069:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658319.366075:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+12:3307:x1875544103721216:12345-0@lo:103: 00010000:00010000:3.0:1788658319.366083:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658319.366094:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dfa00/0xf657f176650ea8ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ea8a7 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.366185:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658319.366216:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+11:3307:x1875544103721216:12345-0@lo:103: Request processed in 141us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.366222:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658319.366249:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103721216:0@lo:103: 00000100:00100000:0.0:1788658319.366372:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721088:0@lo:101: 00010000:00010000:0.0:1788658319.366384:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.366393:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.366497:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721344:0@lo:501: 00000100:00100000:0.0:1788658319.366659:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.366725:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658319.366843:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721344 00000100:00100000:3.0:1788658319.366848:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721344 00000100:00100000:3.0:1788658319.366912:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658319.366919:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721344:12345-0@lo:501: 00000100:00100000:3.0:1788658319.367163:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721344:12345-0@lo:501: Request processed in 243us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.367171:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788658319.367294:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721344:0@lo:501: 00000100:00100000:0.0:1788658319.367324:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721472:0@lo:503: 00000100:00100000:0.0:1788658319.367364:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.367505:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.367659:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721472 00000100:00100000:2.0:1788658319.367683:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721472 00000100:00100000:2.0:1788658319.367707:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658319.367714:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721472:12345-0@lo:503: 00000100:00100000:2.0:1788658319.367937:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721472:12345-0@lo:503: Request processed in 223us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.367944:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788658319.368089:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721472:0@lo:503: 00000040:00080000:0.0:1788658319.368447:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658319.368642:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721600:0@lo:502: 00000100:00100000:0.0:1788658319.368839:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.368924:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.368970:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721600 00000100:00100000:2.0:1788658319.368982:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721600 00000100:00100000:2.0:1788658319.369052:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658319.369061:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721600:12345-0@lo:502: 00000100:00100000:2.0:1788658319.369322:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721600:12345-0@lo:502: Request processed in 261us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.369330:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658319.369405:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721600:0@lo:502: 00000040:00080000:0.0:1788658319.369717:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788658319.369767:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788658319.369821:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788658319.369870:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788658319.369915:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788658319.369946:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788658319.369978:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721728:0@lo:502: 00000100:00100000:0.0:1788658319.370021:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.370388:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658319.370428:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721728 00000100:00100000:3.0:1788658319.370435:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721728 00000100:00100000:3.0:1788658319.370470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658319.370478:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721728:12345-0@lo:502: 00000100:00100000:3.0:1788658319.371009:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721728:12345-0@lo:502: Request processed in 530us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.371017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658319.371082:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721728:0@lo:502: 00000040:00080000:0.0:1788658319.371277:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788658319.371289:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788658319.374776:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658319.374790:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788658319.374809:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658319.374811:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788658319.374819:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658319.374835:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e56c56c0000) 00000020:00000080:2.0:1788658319.374880:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788658319.374888:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658319.374952:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e57014ee800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788658319.374960:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658319.374966:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf657f176650ea8d8 00010000:00010000:3.0:1788658319.379993:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788658319.380383:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788658319.382831:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788658319.383204:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788658319.391327:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788658319.392182:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788658319.395549:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788658319.395566:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658319.395583:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658319.395591:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788658319.395597:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658319.395601:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658319.395602:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788658319.395606:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788658319.395608:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788658319.395684:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658319.395687:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658319.395688:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788658319.395693:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788658319.396436:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788658319.396466:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788658319.396492:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.396512:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658319.396522:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e57014ee800 from 1 10000000:01000000:0.0:1788658319.396525:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658319.396565:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.396924:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.396937:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.396965:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721856:0@lo:101: 00000100:00100000:0.0:1788658319.397036:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.397090:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658319.397227:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721856 00000100:00100000:1.0:1788658319.397236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721856 00000100:00100000:1.0:1788658319.397279:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658319.397288:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+11:6682:x1875544103721856:12345-0@lo:101: 00010000:00010000:1.0:1788658319.397302:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658319.397316:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea8df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.397341:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea8df expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.397352:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8df expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.397362:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679c00, rc 0) 00000100:00100000:1.0:1788658319.397417:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103721856:12345-0@lo:101: Request processed in 129us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658319.397423:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658319.397774:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721856:0@lo:101: 00010000:00010000:0.0:1788658319.397790:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.397809:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.397905:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721984:0@lo:501: 00000100:00100000:0.0:1788658319.397934:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.397991:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658319.400837:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103721984 00000100:00100000:3.0:1788658319.400852:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103721984 00000100:00100000:3.0:1788658319.400935:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788658319.400945:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103721984:12345-0@lo:501: 00000100:00100000:3.0:1788658319.401237:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103721984:12345-0@lo:501: Request processed in 293us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.401245:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658319.401823:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103721984:0@lo:501: 00000100:00100000:2.0:1788658319.401885:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722112:0@lo:503: 00000100:00100000:2.0:1788658319.401929:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.403942:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658319.404116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103722112 00000100:00100000:0.0:1788658319.404126:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103722112 00000100:00100000:0.0:1788658319.404175:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788658319.404184:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103722112:12345-0@lo:503: 00000100:00100000:0.0:1788658319.404768:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103722112:12345-0@lo:503: Request processed in 583us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.404778:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658319.404953:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722112:0@lo:503: 00000040:00080000:2.0:1788658319.405310:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658319.405396:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722240:0@lo:502: 00000100:00100000:2.0:1788658319.405446:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.405486:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658319.405815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103722240 00000100:00100000:0.0:1788658319.405823:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103722240 00000100:00100000:0.0:1788658319.405861:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658319.405871:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103722240:12345-0@lo:502: 00000100:00100000:0.0:1788658319.406107:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103722240:12345-0@lo:502: Request processed in 237us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.406115:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788658319.406317:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722240:0@lo:502: 00000040:00080000:2.0:1788658319.406749:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788658319.406816:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788658319.406852:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722368:0@lo:502: 00000100:00100000:2.0:1788658319.406900:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.406936:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658319.407073:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103722368 00000100:00100000:3.0:1788658319.407080:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103722368 00000100:00100000:3.0:1788658319.407191:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658319.407200:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103722368:12345-0@lo:502: 00000100:00100000:3.0:1788658319.407358:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103722368:12345-0@lo:502: Request processed in 159us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.407366:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788658319.407495:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722368:0@lo:502: 00000040:00080000:2.0:1788658319.407752:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788658319.407763:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788658319.408775:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658319.408788:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658319.408791:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788658319.408808:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e57014ee800 00000020:00000080:2.0:1788658319.408811:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658319.408847:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658319.408851:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658319.408853:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788658319.408856:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788658319.408983:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788658319.409008:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658319.409032:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.409044:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658319.409089:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788658319.409093:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e57014ee800 10000000:01000000:1.0:1788658319.409097:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e57014ee800 10000000:01000000:1.0:1788658319.409102:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788658319.409121:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e57014ee800 from 1 10000000:01000000:1.0:1788658319.409124:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658319.409167:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.409177:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.409188:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658319.409212:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722496:0@lo:101: 00000100:00100000:1.0:1788658319.409281:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.409328:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.409375:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103722496 00000100:00100000:2.0:1788658319.409382:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103722496 00000100:00100000:2.0:1788658319.409424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788658319.409433:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103722496:12345-0@lo:101: 00010000:00010000:2.0:1788658319.409445:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658319.409459:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea8ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.409483:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea8ed expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.409493:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8ed expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.409527:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29df200, rc 0) 00000100:00100000:2.0:1788658319.409732:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103722496:12345-0@lo:101: Request processed in 137us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.409741:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788658319.409927:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722496:0@lo:101: 00010000:00010000:1.0:1788658319.409950:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658319.409971:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658319.410073:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722624:0@lo:501: 00000100:00100000:1.0:1788658319.410101:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.410131:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.410210:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103722624 00000100:00100000:2.0:1788658319.410214:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103722624 00000100:00100000:2.0:1788658319.410248:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788658319.410254:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103722624:12345-0@lo:501: 00000100:00100000:2.0:1788658319.410479:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103722624:12345-0@lo:501: Request processed in 225us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.410486:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788658319.411114:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722624:0@lo:501: 00000100:00100000:1.0:1788658319.411157:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722752:0@lo:503: 00000100:00100000:1.0:1788658319.411208:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.411234:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.411554:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103722752 00000100:00100000:2.0:1788658319.411560:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103722752 00000100:00100000:2.0:1788658319.411701:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788658319.411711:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103722752:12345-0@lo:503: 00000100:00100000:2.0:1788658319.411905:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103722752:12345-0@lo:503: Request processed in 196us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.411913:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658319.412146:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722752:0@lo:503: 00000040:00080000:1.0:1788658319.412504:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658319.412831:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722880:0@lo:502: 00000100:00100000:1.0:1788658319.412888:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.412926:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d0e70300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.413299:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103722880 00000100:00100000:2.0:1788658319.413310:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103722880 00000100:00100000:2.0:1788658319.413359:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788658319.413368:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103722880:12345-0@lo:502: 00000100:00100000:2.0:1788658319.414051:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103722880:12345-0@lo:502: Request processed in 683us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.414061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658319.414248:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103722880:0@lo:502: 00000040:00080000:1.0:1788658319.414526:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788658319.414649:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788658319.414708:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788658319.414750:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788658319.414785:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788658319.414851:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788658319.414887:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788658319.414917:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788658319.415654:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788658319.415728:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788658319.415756:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788658319.415805:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788658319.415853:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788658319.415879:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788658319.415916:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788658319.415943:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788658319.416191:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788658319.416237:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788658319.416264:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788658319.416290:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788658319.416331:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788658319.416362:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788658319.416388:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788658319.416425:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788658319.416452:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788658319.416477:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788658319.416649:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788658319.416920:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788658319.417047:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103723008:0@lo:502: 00000100:00100000:1.0:1788658319.417208:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.417292:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d0e70300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.417336:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723008 00000100:00100000:2.0:1788658319.417352:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723008 00000100:00100000:2.0:1788658319.417410:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658319.417419:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103723008:12345-0@lo:502: 00000100:00100000:2.0:1788658319.417974:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103723008:12345-0@lo:502: Request processed in 554us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.417983:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788658319.418216:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103723008:0@lo:502: 00000040:00080000:1.0:1788658319.418318:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788658319.418333:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788658319.420062:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788658319.420078:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e56c820b380) 00000020:00000080:1.0:1788658319.420100:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788658319.420243:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e57014ee800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788658319.420248:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e57014ee800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788658319.420254:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e57014ee800 3 00010000:00080000:1.0:1788658319.420286:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56ff3d0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.103@tcp at head 00010000:00010000:1.0:1788658319.424075:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788658319.425231:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788658319.425273:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788658319.425287:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf657f176650ea902 00000100:00080000:1.0:1788658319.425301:0:6707:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658319.425308:0:6707:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e56ff3d0800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658319.425354:0:6707:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56de9f8380 x1875544103723136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658319.425434:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103723136:0@lo:38: 00000100:00100000:3.0:1788658319.425516:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788658319.425863:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788658319.426338:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723136 00000100:00100000:0.0:1788658319.426347:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723136 00000100:00100000:0.0:1788658319.426388:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658319.426411:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875544103723136:12345-0@lo:38: 00010000:00080000:0.0:1788658319.426442:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1788658319.426478:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf657f176650ea909 00000004:00100000:0.0:1788658319.426496:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788658319.426688:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103723264:0@lo:400: 00000100:00100000:1.0:1788658319.426740:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.426782:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788658319.426792:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1788658319.426876:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9e57006cb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658319.427823:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875544103723136:12345-0@lo:38: Request processed in 1411us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.427833:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658319.427857:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723264 00000100:00100000:0.0:1788658319.427864:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723264 00000100:00100000:0.0:1788658319.427893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658319.427900:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103723264:12345-0@lo:400: 00000100:00100000:0.0:1788658319.427956:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103723264:12345-0@lo:400: Request processed in 57us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.427972:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788658319.428121:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e56e5b0a680 x1875544103723264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658319.428139:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103723264:0@lo:400: 00000040:00080000:2.0:1788658319.435851:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:3.0:1788658319.436941:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e56de9f8380 x1875544103723136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658319.436956:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658319.436994:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788658319.437005:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788658319.437013:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788658319.437019:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56ff3d0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788658319.437031:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103723136:0@lo:38: 00000020:01000000:2.0:1788658319.437290:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788658319.437325:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658319.437341:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658319.437352:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658319.437403:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658319.437406:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658319.437407:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658319.437408:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658319.437410:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658319.437411:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658319.437413:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658319.437415:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658319.437416:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658319.437418:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658319.437419:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658319.437424:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788658319.437427:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658319.437429:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658319.437430:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658319.437432:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658319.437433:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658319.437434:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658319.437435:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658319.437441:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658319.437442:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658319.437442:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658319.437443:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658319.437474:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788658319.437499:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103723392:0@lo:253: 00000100:00100000:2.0:1788658319.437682:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.437731:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56df1076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658319.437768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723392 00000100:00100000:2.0:1788658319.437776:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723392 00000100:00100000:2.0:1788658319.437833:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658319.437843:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:6682:x1875544103723392:12345-0@lo:253: 20000000:01000000:2.0:1788658319.437873:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788658319.437887:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788658319.501295:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658319.501313:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788658319.501375:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788658319.501381:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788658319.501405:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.501425:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c29dfe00/0xf657f176650ea868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea861 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.501435:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.501483:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c29dfe00/0xf657f176650ea868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea861 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658319.501519:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c29dfe00/0xf657f176650ea868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea861 expref: 13 pid: 5832 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658319.501538:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875544103723520:0@lo:104: 00000100:00100000:0.0:1788658319.501738:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.501788:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef21180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658319.501932:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723520 00000100:00100000:3.0:1788658319.501943:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723520 00000100:00100000:3.0:1788658319.501999:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658319.502009:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:5853:x1875544103723520:12345-0@lo:104: 00010000:00010000:3.0:1788658319.502023:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502077:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788658319.502082:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:5853:x1875544103723520:12345-0@lo:104: Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.502089:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788658319.502123:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658319.502130:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502137:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658319.502141:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502151:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658319.502323:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658319.502329:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658319.502363:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502370:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658319.502387:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502394:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57021d9800/0xf657f176650ea861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea868 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502411:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658319.502413:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658319.502415:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658319.502430:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103723648:0@lo:103: 00000100:00100000:3.0:1788658319.502464:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658319.502503:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723648 00000100:00100000:3.0:1788658319.502507:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723648 00010000:00010000:3.0:1788658319.502524:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c29dfe00/0xf657f176650ea868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea861 expref: 14 pid: 5832 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658319.502546:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658319.502553:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8935850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+14:3304:x1875544103723648:12345-0@lo:103: 00010000:00010000:3.0:1788658319.502563:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658319.502568:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c29dfe00/0xf657f176650ea868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea861 expref: 14 pid: 5832 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502598:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c29dfe00/0xf657f176650ea868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea861 expref: 14 pid: 5832 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502615:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502624:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788658319.502637:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001256948s 00010000:00010000:3.0:1788658319.502642:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502649:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502656:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502713:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502720:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0030000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658319.502724:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502734:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502742:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502764:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658319.502793:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8935850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+14:3304:x1875544103723648:12345-0@lo:103: Request processed in 241us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.502811:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658319.502884:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103723648:0@lo:103: 00010000:00010000:3.0:1788658319.502926:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dfe00/0xf657f176650ea868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea861 expref: 13 pid: 5832 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658319.502937:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875544103723520:0@lo:104: 00010000:00010000:3.0:1788658319.502952:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502961:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502966:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658319.502972:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c0030000/0xf657f176650ea910 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658319.514818:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+12:6682:x1875544103723392:12345-0@lo:253: Request processed in 76957us (77134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.514835:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658319.515027:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:6682:1875544103723392:0@lo:253: 10000000:01000000:2.0:1788658319.515047:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788658319.515051:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658319.515053:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658319.515054:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658319.515056:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658319.515057:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658319.515059:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658319.515060:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658319.515062:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658319.515063:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658319.515065:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658319.515066:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788658319.515087:0:6682:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788658319.521572:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658319.521921:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658319.522089:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658319.522337:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658319.522524:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658319.523328:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788658319.525399:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788658319.790267:0:6682:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788658319.790274:0:6682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788658319.790306:0:6682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658319.790361:0:6682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658319.790377:0:6682:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788658319.790406:0:6682:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1788658320.095093:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788658320.095101:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56f44c2000 from 21 10000000:01000000:1.0:1788658320.095107:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658320.095153:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658320.095177:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658320.095190:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658320.095215:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103723776:0@lo:101: 00000100:00100000:1.0:1788658320.095286:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658320.095346:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c652cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.095540:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723776 00000100:00100000:2.0:1788658320.095548:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723776 00000100:00100000:2.0:1788658320.095599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788658320.095610:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103723776:12345-0@lo:101: 00010000:00010000:2.0:1788658320.095623:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658320.095636:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea917 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.096460:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea917 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.096481:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea917 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.096491:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dec00, rc 0) 00000100:00100000:2.0:1788658320.096556:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103723776:12345-0@lo:101: Request processed in 947us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.096564:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658320.097184:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103723776:0@lo:101: 00010000:00010000:1.0:1788658320.097207:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658320.097218:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658320.097292:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103723904:0@lo:501: 00000100:00100000:1.0:1788658320.097343:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658320.097374:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c652cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788658320.098569:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658320.098587:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103723904 00000100:00100000:3.0:1788658320.098597:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103723904 00000100:00100000:3.0:1788658320.098655:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788658320.099366:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103723904:12345-0@lo:501: 00000100:00100000:3.0:1788658320.100394:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103723904:12345-0@lo:501: Request processed in 1727us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658320.100404:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658320.101905:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103723904:0@lo:501: 00000100:00100000:1.0:1788658320.101971:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724032:0@lo:503: 00000100:00100000:1.0:1788658320.102043:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658320.102088:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c652cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.102483:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724032 00000100:00100000:2.0:1788658320.102492:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724032 00000100:00100000:2.0:1788658320.102540:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788658320.102550:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103724032:12345-0@lo:503: 00000100:00100000:2.0:1788658320.103095:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103724032:12345-0@lo:503: Request processed in 545us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.103104:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658320.103261:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724032:0@lo:503: 00000100:00100000:3.0:1788658320.104418:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6728:1875544103724160:0@lo:502: 00000100:00100000:3.0:1788658320.104480:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658320.104522:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658320.104886:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724160 00000100:00100000:1.0:1788658320.104899:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724160 00000100:00100000:1.0:1788658320.104945:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658320.104971:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:6728:x1875544103724160:12345-0@lo:502: 00000100:00100000:1.0:1788658320.105882:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:6728:x1875544103724160:12345-0@lo:502: Request processed in 910us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658320.105893:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788658320.106035:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6728:1875544103724160:0@lo:502: 00000100:00100000:3.0:1788658320.106096:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6728:1875544103724288:0@lo:502: 00000100:00100000:3.0:1788658320.106202:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.106226:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724288 00000100:00100000:2.0:1788658320.106232:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724288 00000100:00100000:3.0:1788658320.106233:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.106276:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788658320.106290:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:6728:x1875544103724288:12345-0@lo:502: 00000100:00100000:2.0:1788658320.106932:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:6728:x1875544103724288:12345-0@lo:502: Request processed in 642us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.106941:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658320.112866:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6728:1875544103724288:0@lo:502: 00000040:00080000:3.0:1788658320.112914:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788658320.113271:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788658320.113416:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658320.113428:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.113440:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658320.113450:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658320.113453:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56f44c2000 from 4 10000000:01000000:2.0:1788658320.113456:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658320.113497:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.113505:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.113516:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658320.113613:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724416:0@lo:101: 00000100:00100000:2.0:1788658320.113814:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.113897:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658320.113941:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724416 00000100:00100000:3.0:1788658320.113949:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724416 00000100:00100000:3.0:1788658320.114075:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658320.114085:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103724416:12345-0@lo:101: 00010000:00010000:3.0:1788658320.114099:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658320.114114:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea925 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658320.114139:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea925 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658320.114149:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea925 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658320.114169:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9800, rc 0) 00000100:00100000:3.0:1788658320.114208:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103724416:12345-0@lo:101: Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658320.114215:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788658320.114292:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724416:0@lo:101: 00010000:00010000:2.0:1788658320.114371:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.114387:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658320.114437:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724544:0@lo:256: 00000100:00100000:2.0:1788658320.114468:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.114489:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658320.114602:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724544 00000100:00100000:3.0:1788658320.114607:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724544 00000100:00100000:3.0:1788658320.114695:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658320.114701:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103724544:12345-0@lo:256: 20000000:01000000:3.0:1788658320.114715:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658320.114730:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658320.114733:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788658320.114807:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103724544:12345-0@lo:256: Request processed in 105us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658320.114813:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788658320.114956:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724544:0@lo:256: 10000000:01000000:2.0:1788658320.115004:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658320.115010:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.115018:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658320.115026:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788658320.115028:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788658320.115030:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788658320.115046:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.115053:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.115061:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658320.115073:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724672:0@lo:101: 00000100:00100000:2.0:1788658320.115102:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.115121:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.115132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724672 00000100:00100000:2.0:1788658320.115136:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724672 00000100:00100000:2.0:1788658320.115158:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658320.115164:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103724672:12345-0@lo:101: 00010000:00010000:2.0:1788658320.115172:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658320.115181:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea933 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.115197:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea933 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.115205:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea933 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.115211:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dee00, rc 0) 00000100:00100000:2.0:1788658320.115237:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103724672:12345-0@lo:101: Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.115243:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658320.115270:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724672:0@lo:101: 00010000:00010000:2.0:1788658320.115280:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.115288:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658320.115341:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724800:0@lo:501: 00000100:00100000:2.0:1788658320.115372:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.115384:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.115394:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724800 00000100:00100000:2.0:1788658320.115398:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724800 00000100:00100000:2.0:1788658320.115417:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658320.115422:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103724800:12345-0@lo:501: 00000100:00100000:2.0:1788658320.115907:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103724800:12345-0@lo:501: Request processed in 484us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.115914:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658320.115941:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724800:0@lo:501: 00000100:00100000:2.0:1788658320.115966:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724928:0@lo:503: 00000100:00100000:2.0:1788658320.116060:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.116073:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.116083:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103724928 00000100:00100000:2.0:1788658320.116086:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103724928 00000100:00100000:2.0:1788658320.116104:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658320.116110:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103724928:12345-0@lo:503: 00000100:00100000:2.0:1788658320.116312:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103724928:12345-0@lo:503: Request processed in 202us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.116319:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658320.116355:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103724928:0@lo:503: 00000100:00100000:2.0:1788658320.116518:0:6730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6730:1875544103725056:0@lo:502: 00000100:00100000:2.0:1788658320.116614:0:6730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.116634:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725056 00000100:00100000:2.0:1788658320.116637:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725056 00000100:00100000:2.0:1788658320.116657:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788658320.116759:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:6730:x1875544103725056:12345-0@lo:502: 00000100:00100000:2.0:1788658320.116947:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:6730:x1875544103725056:12345-0@lo:502: Request processed in 190us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.116954:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788658320.117109:0:6730:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.117122:0:6730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6730:1875544103725056:0@lo:502: 00000020:01000000:2.0:1788658320.117146:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658320.117154:0:6730:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788658320.117161:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658320.117163:0:6730:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788658320.117168:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788658320.117173:0:6730:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:2.0:1788658320.117196:0:6730:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788658320.117199:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658320.117218:0:6730:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e56c83e0000) 00000020:00000080:2.0:1788658320.117238:0:6730:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788658320.117244:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788658320.117360:0:6730:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788658320.117365:0:6730:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788658320.117372:0:6730:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ea948 00010000:00080000:2.0:1788658320.117400:0:6730:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56de8c1000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1788658320.117764:0:6730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788658320.171384:0:6730:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788658320.171409:0:6730:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788658320.172983:0:6730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658320.174905:0:6730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658320.174974:0:6730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788658320.175038:0:6730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788658320.175507:0:6733:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658320.175512:0:6733:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788658320.176088:0:6730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658320.176101:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788658320.176131:0:6730:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788658320.176154:0:6730:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ea94f 00000100:00080000:2.0:1788658320.176166:0:6730:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658320.176179:0:6730:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e56de8c1000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658320.176227:0:6730:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56c5732300 x1875544103725184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658320.176247:0:6730:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788658320.176304:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658320.176309:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658320.176311:0:6730:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788658320.176313:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658320.176317:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658320.176318:0:6730:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658320.176320:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658320.176322:0:6730:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788658320.176354:0:6730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6730:1875544103725312:0@lo:502: 00000100:00100000:2.0:1788658320.176435:0:6730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.177130:0:6730:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.177161:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103725184:0@lo:8: 00000100:00100000:2.0:1788658320.177210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658320.177251:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725184 00000100:00100000:1.0:1788658320.177260:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725184 00000100:00100000:2.0:1788658320.177299:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725312 00000100:00100000:1.0:1788658320.177300:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658320.177302:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725312 00000100:00100000:1.0:1788658320.177308:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103725184:12345-0@lo:8: 00000100:00100000:2.0:1788658320.177329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788658320.177333:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000100:00100000:2.0:1788658320.177334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:6730:x1875544103725312:12345-0@lo:502: 00000020:00000080:1.0:1788658320.177715:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ea956 00002000:00100000:1.0:1788658320.177753:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e56ff3d6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788658320.177758:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788658320.177762:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788658320.178376:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:6730:x1875544103725312:12345-0@lo:502: Request processed in 1038us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.178386:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658320.178438:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103725440:0@lo:400: 00000100:00100000:2.0:1788658320.178482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1788658320.178505:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788658320.178528:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103725568:0@lo:400: 00000100:00100000:2.0:1788658320.178553:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.178617:0:6730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:6730:1875544103725312:0@lo:502: 00000020:01000000:2.0:1788658320.178650:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658320.178657:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658320.178659:0:6730:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00002000:00080000:1.0:1788658320.178989:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788658320.179019:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9e56ff3d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658320.179071:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875544103725184:12345-0@lo:8: Request processed in 1763us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658320.179079:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658320.179265:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725440 00000100:00100000:0.0:1788658320.179273:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725440 00000100:00100000:0.0:1788658320.179310:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725568 00000100:00100000:0.0:1788658320.179313:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725568 00000100:00100000:0.0:1788658320.179746:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658320.179757:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103725440:12345-0@lo:400: 00000040:00080000:2.0:1788658320.179779:0:6730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788658320.179906:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788658320.179924:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788658320.179936:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.179947:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658320.179958:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788658320.179961:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e56c56c19c0 from 1 10000000:01000000:2.0:1788658320.179964:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788658320.179996:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.180004:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.180015:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658320.180031:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103725696:0@lo:101: 00000100:00100000:2.0:1788658320.180073:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.180103:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f4500780 going to sleep for 11 seconds 00010000:00080000:2.0:1788658320.180131:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5732300 x1875544103725184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658320.180156:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658320.180164:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788658320.180173:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788658320.180179:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788658320.180182:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56de8c1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788658320.180191:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788658320.180197:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103725184:0@lo:8: 00000004:00080000:2.0:1788658320.180220:0:6733:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788658320.180245:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103725440:12345-0@lo:400: Request processed in 491us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658320.180252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658320.180268:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658320.180275:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103725568:12345-0@lo:400: 00000100:00100000:0.0:1788658320.180308:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103725568:12345-0@lo:400: Request processed in 34us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658320.180314:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788658320.180335:0:6733:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 211319669749ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788658320.180409:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788658320.180439:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5731c00 x1875544103725568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658320.180448:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103725568:0@lo:400: 00010000:00080000:1.0:1788658320.180701:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5730380 x1875544103725440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658320.180720:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103725440:0@lo:400: 00000100:00100000:2.0:1788658320.181498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725696 00000100:00100000:2.0:1788658320.181505:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725696 00000100:00100000:2.0:1788658320.181544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658320.181552:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103725696:12345-0@lo:101: 00010000:00010000:2.0:1788658320.181563:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658320.181592:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea95d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.181618:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea95d expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.181629:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea95d expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.181639:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc000, rc 0) 00000100:00100000:2.0:1788658320.184004:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103725696:12345-0@lo:101: Request processed in 2443us (3920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.184017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658320.184103:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103725696:0@lo:101: 00010000:00010000:2.0:1788658320.184131:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.184146:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658320.184223:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103725824:0@lo:501: 00000100:00100000:2.0:1788658320.184265:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658320.184294:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.184312:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725824 00000100:00100000:2.0:1788658320.184317:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725824 00000100:00100000:2.0:1788658320.184353:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658320.184361:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103725824:12345-0@lo:501: 00000100:00100000:2.0:1788658320.184759:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103725824:12345-0@lo:501: Request processed in 398us (493us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658320.184766:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658320.184798:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103725824:0@lo:501: 10000000:01000000:2.0:1788658320.184838:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788658320.184846:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658320.184855:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658320.263557:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788658320.324983:0:6734:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788658320.325022:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726080:0@lo:7: 00000100:00100000:1.0:1788658320.325100:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658320.325157:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6fb4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658320.325653:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658320.326783:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726080 00000100:00100000:2.0:1788658320.326800:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726080 00000100:00100000:1.0:1788658320.326951:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103725952:0@lo:13: 00000100:00100000:1.0:1788658320.327020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658320.327596:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103725952 00000100:00100000:1.0:1788658320.327604:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103725952 00000100:00100000:1.0:1788658320.327659:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658320.327687:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103725952:12345-0@lo:13: 00002000:00000024:1.0:1788658320.327715:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1788658320.327775:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103725952:12345-0@lo:13: Request processed in 89us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658320.327783:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788658320.327899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9f8700 x1875544103725952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658320.327922:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103725952:0@lo:13: 00000100:00100000:2.0:1788658320.330165:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658320.330189:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6734:x1875544103726080:12345-0@lo:7: 00000100:00080000:3.0:1788658320.332964:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788658320.336159:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788658320.336167:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788658320.336292:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6734:x1875544103726080:12345-0@lo:7: Request processed in 6104us (11186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658320.336303:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788658320.338276:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9f9f80 x1875544103726080/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658336 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658320.338310:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726080:0@lo:7: 00000004:00080000:0.0:1788658320.338329:0:6734:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788658320.338384:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726208:0@lo:5: 00000100:00100000:0.0:1788658320.338451:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658320.338499:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c56776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658320.338525:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726208 00000100:00100000:0.0:1788658320.338532:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726208 00000100:00100000:0.0:1788658320.338588:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658320.338597:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6734:x1875544103726208:12345-0@lo:5: 00002000:00080000:0.0:1788658320.338627:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788658320.338631:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788658320.339073:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6734:x1875544103726208:12345-0@lo:5: Request processed in 475us (621us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788658320.339080:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788658320.339118:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56e5b09180 x1875544103726208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658336 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658320.339132:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726208:0@lo:5: 00000004:00080000:0.0:1788658320.339141:0:6734:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788658320.339168:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726336:0@lo:700: 00000100:00100000:0.0:1788658320.339195:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658320.339220:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c56776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658320.340031:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726336 00000100:00100000:0.0:1788658320.340039:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726336 00000100:00100000:0.0:1788658320.340738:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658320.340753:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6734:x1875544103726336:12345-0@lo:700: 00000100:00100000:0.0:1788658320.340837:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6693:1875544103726464:0@lo:700: 00000100:00100000:0.0:1788658320.340898:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658320.340936:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658320.341043:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726464 00000100:00100000:1.0:1788658320.341049:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726464 00000100:00100000:1.0:1788658320.341083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658320.341090:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6693:x1875544103726464:12345-0@lo:700: 40000000:02000000:1.0:1788658320.392467:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788658320.397515:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6693:x1875544103726464:12345-0@lo:700: Request processed in 56416us (56607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658320.397545:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788658320.397653:0:6693:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56e5b0b800 x1875544103726464/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788658336 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658320.397709:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6693:1875544103726464:0@lo:700: 40000000:02000000:0.0:1788658320.397724:0:6693:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788658320.438907:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6734:x1875544103726336:12345-0@lo:700: Request processed in 98150us (99700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658320.438926:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788658320.438930:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56e5b0bb80 x1875544103726336/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788658336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658320.438951:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726336:0@lo:700: 00000001:00080000:3.0:1788658320.439026:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788658320.439041:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1788658320.471999:0:6734:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788658320.477588:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726592:0@lo:5: 00000100:00100000:0.0:1788658320.477713:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658320.477776:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658320.477987:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726592 00000100:00100000:2.0:1788658320.477999:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726592 00000100:00100000:2.0:1788658320.478102:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658320.478113:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6734:x1875544103726592:12345-0@lo:5: 00002000:00080000:2.0:1788658320.482541:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788658320.482564:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788658320.486196:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6734:x1875544103726592:12345-0@lo:5: Request processed in 8076us (8474us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788658320.486211:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788658320.486386:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56e5b0bb80 x1875544103726592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658320.486404:0:6734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788658320.486425:0:6734:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e56e5b0bb80 x1875544103726592/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658336 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658320.486439:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875544103726592:0@lo:5: 00000004:00080000:1.0:1788658320.486458:0:6734:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788658321.121815:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658322.147865:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658323.164833:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658324.193777:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658325.214393:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658325.404806:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658325.404839:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103726720:0@lo:13: 00000100:00100000:1.0:1788658325.404921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658325.405003:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726720 00000100:00100000:1.0:1788658325.405014:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726720 00000100:00100000:1.0:1788658325.405077:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658325.405087:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103726720:12345-0@lo:13: 00002000:00000024:1.0:1788658325.405129:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658325.405177:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103726720:12345-0@lo:13: Request processed in 90us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658325.405184:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788658325.405243:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9f8700 x1875544103726720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658325.405264:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103726720:0@lo:13: 00000100:00080000:3.0:1788658325.405455:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658325.409700:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103726848:0@lo:400: 00000100:00100000:3.0:1788658325.409787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658325.409849:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103726976:0@lo:400: 00000100:00100000:3.0:1788658325.409910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658325.409937:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658325.409942:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103727104:0@lo:400: 00000100:00100000:3.0:1788658325.409977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658325.410035:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726848 00000100:00100000:3.0:1788658325.410045:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726848 00000100:00100000:3.0:1788658325.410097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658325.410106:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:3305:x1875544103726848:12345-0@lo:400: 00000100:00100000:3.0:1788658325.410157:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:3305:x1875544103726848:12345-0@lo:400: Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658325.410165:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658325.410201:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103726976 00000100:00100000:3.0:1788658325.410205:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103726976 00000100:00100000:3.0:1788658325.410241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103727104 00000100:00100000:3.0:1788658325.410245:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103727104 00000100:00100000:3.0:1788658325.410274:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658325.410280:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103726976:12345-0@lo:400: 00000100:00100000:3.0:1788658325.410316:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103726976:12345-0@lo:400: Request processed in 36us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658325.410323:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658325.410334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658325.410340:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103727104:12345-0@lo:400: 00000100:00100000:3.0:1788658325.410363:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103727104:12345-0@lo:400: Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658325.410369:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788658325.410399:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788658325.410429:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e57014bd500 x1875544103727104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658325.410446:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103727104:0@lo:400: 00010000:00080000:3.0:1788658325.410456:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e57014bed80 x1875544103726976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658325.410472:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103726976:0@lo:400: 00000100:00100000:3.0:1788658325.410507:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103726848:0@lo:400: 00000001:00080000:3.0:1788658325.515354:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:1.0:1788658325.826581:0:7055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788658326.252980:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658327.261495:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658328.285007:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658329.309955:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658330.333292:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658330.532847:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103727232:0@lo:400: 00000100:00100000:3.0:1788658330.532933:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658330.536526:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658330.536552:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103727360:0@lo:400: 00000100:00100000:3.0:1788658330.536636:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658330.536707:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103727232 00000100:00100000:3.0:1788658330.536718:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103727232 00000100:00100000:3.0:1788658330.536767:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788658330.536776:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:3304:x1875544103727232:12345-0@lo:400: 00000100:00100000:3.0:1788658330.536952:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:3304:x1875544103727232:12345-0@lo:400: Request processed in 177us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658330.536960:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788658330.537008:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103727488:0@lo:13: 00000100:00100000:3.0:1788658330.537043:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658330.537103:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103727360 00000100:00100000:3.0:1788658330.537107:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103727360 00000100:00100000:3.0:1788658330.537133:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658330.537150:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103727360:12345-0@lo:400: 00000100:00100000:3.0:1788658330.537184:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103727360:12345-0@lo:400: Request processed in 45us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658330.537190:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788658330.537228:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5732300 x1875544103727360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658330.537254:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103727360:0@lo:400: 00000100:00100000:3.0:1788658330.537267:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103727232:0@lo:400: 00000100:00100000:3.0:1788658330.537300:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103727488 00000100:00100000:3.0:1788658330.537303:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103727488 00000100:00100000:3.0:1788658330.537524:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658330.537532:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103727488:12345-0@lo:13: 00002000:00000024:3.0:1788658330.537560:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788658330.537600:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103727488:12345-0@lo:13: Request processed in 69us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658330.537605:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788658330.537743:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658330.538043:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9f8700 x1875544103727488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658330.538053:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788658330.538072:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103727488:0@lo:13: 00000100:00100000:2.0:1788658330.538119:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658330.538168:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103727616:0@lo:400: 00000100:00100000:2.0:1788658330.538203:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658330.538880:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103727616 00000100:00100000:2.0:1788658330.538887:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103727616 00000100:00100000:2.0:1788658330.538946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658330.538956:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103727616:12345-0@lo:400: 00000100:00100000:2.0:1788658330.539017:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103727616:12345-0@lo:400: Request processed in 64us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658330.539024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788658330.539043:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788658330.539065:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5732a00 x1875544103727616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658330.539078:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103727616:0@lo:400: 00010000:00010000:2.0:1788658331.357122:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658332.382566:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658333.406055:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658334.429908:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658335.452900:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658335.647307:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103727744:0@lo:400: 00000100:00100000:2.0:1788658335.647390:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658335.647453:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658335.647460:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103727872:0@lo:400: 00000100:00100000:2.0:1788658335.647488:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658335.647518:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103728000:0@lo:400: 00000100:00100000:2.0:1788658335.647540:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658335.647556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658335.647561:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103728128:0@lo:400: 00000100:00100000:2.0:1788658335.647582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658335.647628:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103727744 00000100:00100000:2.0:1788658335.647636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103727744 00000100:00100000:2.0:1788658335.647705:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658335.647715:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:3304:x1875544103727744:12345-0@lo:400: 00000100:00100000:2.0:1788658335.647766:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:3304:x1875544103727744:12345-0@lo:400: Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658335.647785:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658335.647820:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103727872 00000100:00100000:2.0:1788658335.647823:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103727872 00000100:00100000:2.0:1788658335.647844:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728000 00000100:00100000:2.0:1788658335.647847:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728000 00000100:00100000:2.0:1788658335.647872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658335.647879:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103727872:12345-0@lo:400: 00000100:00100000:2.0:1788658335.647910:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103727872:12345-0@lo:400: Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658335.647916:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658335.647926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658335.647932:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103728000:12345-0@lo:400: 00000100:00100000:2.0:1788658335.647958:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103728000:12345-0@lo:400: Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658335.647963:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658335.647981:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728128 00000100:00100000:2.0:1788658335.647984:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728128 00000100:00100000:2.0:1788658335.648006:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658335.648012:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103728128:12345-0@lo:400: 00000100:00100000:2.0:1788658335.648036:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103728128:12345-0@lo:400: Request processed in 24us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658335.648041:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788658335.648212:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5733b80 x1875544103727872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658335.648229:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103727872:0@lo:400: 00000100:00100000:2.0:1788658335.648243:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103727744:0@lo:400: 00000100:00080000:2.0:1788658335.648278:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658335.648284:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788658335.648320:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5731f80 x1875544103728128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658335.648328:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103728128:0@lo:400: 00010000:00080000:2.0:1788658335.648338:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5733100 x1875544103728000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658335.648346:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103728000:0@lo:400: 00000100:00100000:1.0:1788658335.648886:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103728256:0@lo:13: 00000100:00100000:1.0:1788658335.648925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658335.648969:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728256 00000100:00100000:1.0:1788658335.648975:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728256 00000100:00100000:1.0:1788658335.649007:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658335.649014:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103728256:12345-0@lo:13: 00002000:00000024:1.0:1788658335.649042:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658335.649093:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103728256:12345-0@lo:13: Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658335.649100:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788658335.649128:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9fbb80 x1875544103728256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658335.649140:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103728256:0@lo:13: 00010000:00010000:2.0:1788658336.477641:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788658337.253630:0:7629:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788658337.253635:0:7629:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788658337.254452:0:7629:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e56fef6c800 00000020:01000004:1.0:1788658337.254471:0:7629:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788658337.254484:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788658337.254507:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e56c644cd40) 00000020:00000080:1.0:1788658337.254524:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788658337.314603:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788658337.315281:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788658337.363211:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788658337.395648:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788658337.407800:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788658337.407916:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788658337.407946:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788658337.409288:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788658337.409303:0:7629:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788658337.409322:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf657f176650ea972 00000020:01000004:1.0:1788658337.409332:0:7629:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788658337.409368:0:7629:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788658337.409372:0:7629:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788658337.409379:0:7629:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788658337.409404:0:7629:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788658337.409409:0:7629:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788658337.452946:0:7629:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658337.452987:0:7629:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.103@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788658337.452992:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658337.452994:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658337.452995:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658337.452996:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658337.452998:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658337.452999:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658337.453001:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658337.453002:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658337.453015:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658337.453017:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658337.453018:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658337.453022:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788658337.453025:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658337.453027:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658337.453028:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658337.453029:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658337.453030:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658337.453031:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658337.453037:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658337.453038:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658337.453039:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658337.453040:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658337.453041:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658337.453082:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788658337.453104:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103728384:0@lo:253: 00000100:00100000:2.0:1788658337.453179:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.453253:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.453511:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728384 00000100:00100000:3.0:1788658337.453521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728384 00000100:00100000:3.0:1788658337.453579:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658337.453589:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:7629:x1875544103728384:12345-0@lo:253: 20000000:01000000:3.0:1788658337.453620:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788658337.453626:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788658337.453631:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788658337.453635:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788658337.454701:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658337.454932:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788658337.454947:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788658337.454986:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788658337.454994:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788658337.457213:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788658337.457310:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788658337.457801:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788658337.457823:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:3.0:1788658337.457826:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788658337.457861:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788658337.457870:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788658337.457947:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788658337.458579:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:3.0:1788658337.458642:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788658337.458654:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788658337.458734:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788658337.458809:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788658337.461491:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788658337.461528:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:3.0:1788658337.461532:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788658337.461571:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788658337.461580:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788658337.461611:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788658337.461619:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:3.0:1788658337.461651:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788658337.461661:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788658337.461739:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788658337.467395:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788658337.467451:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788658337.467455:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788658337.467462:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788658337.467464:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788658337.467466:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788658337.467486:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788658337.467489:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788658337.467543:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788658337.467546:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788658337.468502:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788658337.469196:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788658337.469256:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788658337.469363:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788658337.469377:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788658337.469380:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788658337.472995:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788658337.473104:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788658337.473326:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788658337.473739:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788658337.473781:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788658337.473809:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788658337.473820:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788658337.473823:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788658337.479718:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788658337.479841:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788658337.479902:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788658337.480525:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788658337.480593:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788658337.480661:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788658337.480708:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788658337.480711:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788658337.482524:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788658337.482651:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788658337.482762:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788658337.483383:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788658337.483433:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788658337.483492:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1788658337.483512:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788658337.483535:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.483555:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.483562:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8ed expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.483569:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea917 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.483575:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea933 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.483581:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea95d expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.483589:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.483647:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea95d expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.484404:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea95d expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.484426:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728512:0@lo:104: 00000100:00100000:3.0:1788658337.484501:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658337.484565:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea933 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.484574:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea933 expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.484583:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728640:0@lo:104: 00010000:00010000:3.0:1788658337.484610:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea917 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.484618:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea917 expref: 16 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.484625:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728768:0@lo:104: 00010000:00010000:3.0:1788658337.484648:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea8ed expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.484656:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea8ed expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658337.484884:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788658337.484907:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.484930:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.484945:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728512 00000100:00100000:0.0:1788658337.484954:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728512 00000100:00100000:0.0:1788658337.484996:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728640 00000100:00100000:0.0:1788658337.484999:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728640 00000100:00100000:0.0:1788658337.485025:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728768 00000100:00100000:0.0:1788658337.485028:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728768 00000100:00100000:0.0:1788658337.485043:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658337.485052:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56f4549850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+5:5832:x1875544103728512:12345-0@lo:104: 00010000:00010000:0.0:1788658337.485067:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485124:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658337.485131:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56f4549850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+5:5832:x1875544103728512:12345-0@lo:104: Request processed in 79us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.485139:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658337.485177:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658337.485184:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5832:x1875544103728640:12345-0@lo:104: 00010000:00010000:0.0:1788658337.485192:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485225:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658337.485230:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5832:x1875544103728640:12345-0@lo:104: Request processed in 48us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.485236:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658337.485263:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658337.485268:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:5832:x1875544103728768:12345-0@lo:104: 00010000:00010000:0.0:1788658337.485276:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485303:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788658337.485307:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:5832:x1875544103728768:12345-0@lo:104: Request processed in 40us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.485313:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788658337.485331:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788658337.485337:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485345:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29df600 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658337.485361:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485370:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658337.485377:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658337.485384:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658337.485419:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485425:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658337.485441:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485458:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c29df600/0xf657f176650ea95d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea964 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485473:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658337.485476:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485482:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfa00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658337.485484:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485491:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658337.485497:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658337.485502:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658337.485516:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485522:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658337.485538:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485544:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfa00/0xf657f176650ea933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea93a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485554:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658337.485562:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485568:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679600 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658337.485570:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485577:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658337.485583:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658337.485588:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658337.485601:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485606:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658337.485611:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485617:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea91e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.485627:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658337.485629:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658337.485631:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658337.485981:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103729152:0@lo:103: 00000100:00100000:0.0:1788658337.486072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.486114:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658337.486120:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103729280:0@lo:103: 00000100:00100000:0.0:1788658337.486151:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658337.486491:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658337.486506:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103729024:0@lo:103: 00000100:00100000:1.0:1788658337.486536:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.486603:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729152 00000100:00100000:1.0:1788658337.486610:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729152 00010000:00010000:1.0:1788658337.486638:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea933 expref: 17 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658337.486706:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729280 00000100:00100000:1.0:1788658337.486710:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729280 00010000:00010000:1.0:1788658337.486723:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea917 expref: 18 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658337.486733:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729024 00000100:00100000:1.0:1788658337.486735:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729024 00010000:00010000:1.0:1788658337.486744:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea95d expref: 19 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658337.486759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658337.486766:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103729152:12345-0@lo:103: 00010000:00010000:1.0:1788658337.486779:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658337.486784:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea933 expref: 19 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.486807:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea933 expref: 19 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.486825:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658337.486864:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103729152:12345-0@lo:103: Request processed in 98us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.486871:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658337.486887:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658337.486893:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+18:3306:x1875544103729280:12345-0@lo:103: 00010000:00010000:1.0:1788658337.486917:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658337.486922:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea917 expref: 18 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.486931:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea917 expref: 18 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.486940:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658337.486962:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+18:3306:x1875544103729280:12345-0@lo:103: Request processed in 70us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.486968:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658337.486980:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658337.486986:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+17:3305:x1875544103729024:12345-0@lo:103: 00010000:00010000:1.0:1788658337.486992:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658337.486996:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea95d expref: 17 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.487018:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea95d expref: 17 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.487035:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658337.487063:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+17:3305:x1875544103729024:12345-0@lo:103: Request processed in 76us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.487069:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658337.487115:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103729024:0@lo:103: 00000100:00100000:1.0:1788658337.487142:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103729280:0@lo:103: 00000100:00100000:1.0:1788658337.487150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103729152:0@lo:103: 00000100:00100000:3.0:1788658337.487412:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728896:0@lo:104: 00000100:00100000:3.0:1788658337.487457:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658337.487508:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.487521:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.487530:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103729408:0@lo:104: 00000100:00100000:3.0:1788658337.487550:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658337.487567:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6ae0840 going to sleep for 11 seconds 00010000:00010000:3.0:1788658337.487580:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cc000/0xf657f176650ea964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea95d expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.487592:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728512:0@lo:104: 00010000:00010000:3.0:1788658337.487601:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dee00/0xf657f176650ea93a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea933 expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.487610:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728640:0@lo:104: 00010000:00010000:3.0:1788658337.487619:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dec00/0xf657f176650ea91e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea917 expref: 14 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.487628:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728768:0@lo:104: 00000100:00100000:1.0:1788658337.487811:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103728896 00000100:00100000:1.0:1788658337.487817:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103728896 00000100:00100000:1.0:1788658337.487839:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729408 00000100:00100000:1.0:1788658337.487842:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729408 00000100:00100000:1.0:1788658337.487853:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658337.487860:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5832:x1875544103728896:12345-0@lo:104: 00010000:00010000:1.0:1788658337.487873:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.487968:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658337.487975:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:5832:x1875544103728896:12345-0@lo:104: Request processed in 116us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.487982:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658337.487996:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658337.488002:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:5832:x1875544103729408:12345-0@lo:104: 00010000:00010000:1.0:1788658337.488024:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488147:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658337.488155:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488163:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658337.488167:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488176:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658337.488185:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658337.488190:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788658337.488199:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103728896:0@lo:104: 00000100:00100000:3.0:1788658337.488211:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1875544103729408:0@lo:104: 00010000:00010000:0.0:1788658337.488222:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488231:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658337.488238:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488248:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488257:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650ea8ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488271:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658337.488274:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488280:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0031e00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658337.488290:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488296:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658337.488302:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658337.488307:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658337.488321:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488327:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658337.488333:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488339:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0031e00/0xf657f176650ea8c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.488365:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658337.488367:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658337.488369:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658337.488395:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103729536:0@lo:103: 00010000:00010000:1.0:1788658337.488477:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788658337.488489:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:5832:x1875544103729408:12345-0@lo:104: Request processed in 488us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.488500:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658337.488522:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103729664:0@lo:103: 00010000:00010000:3.0:1788658337.488529:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658337.488554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.488914:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658337.489270:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729664 00000100:00100000:3.0:1788658337.489278:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729664 00010000:00010000:3.0:1788658337.489307:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 14 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.489337:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729536 00000100:00100000:3.0:1788658337.489340:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729536 00010000:00010000:3.0:1788658337.489361:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea8ed expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.489376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658337.489384:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+15:3305:x1875544103729664:12345-0@lo:103: 00010000:00010000:3.0:1788658337.489395:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658337.489400:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658337.489473:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788658337.489482:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788658337.489815:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658337.489826:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+15:3304:x1875544103729536:12345-0@lo:103: 00010000:00010000:2.0:1788658337.489835:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658337.489841:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea8ed expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.489853:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea8ed expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.489869:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29df200/0xf657f176650ea8f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea8ed expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.489883:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658337.489925:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+14:3304:x1875544103729536:12345-0@lo:103: Request processed in 102us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.489945:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788658337.490248:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 13 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490259:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d9600/0xf657f176650ea8ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea8c3 expref: 13 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490272:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490281:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490298:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490305:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490319:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490326:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490331:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658337.490335:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490344:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658337.490492:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103729536:0@lo:103: 00010000:00010000:2.0:1788658337.490631:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.490640:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788658337.490648:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788658337.490943:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490954:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d8400/0xf657f176650ea979 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.490972:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658337.491117:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+12:3305:x1875544103729664:12345-0@lo:103: Request processed in 1733us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.491125:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658337.491296:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103729664:0@lo:103: 00010000:00010000:0.0:1788658337.503638:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658337.581910:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+11:7629:x1875544103728384:12345-0@lo:253: Request processed in 128311us (128720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.581927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788658337.582017:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103728384:0@lo:253: 10000000:01000000:2.0:1788658337.582038:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788658337.582041:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658337.582043:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658337.582045:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658337.582046:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788658337.582048:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658337.582049:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658337.582051:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658337.582052:0:7629:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788658337.582054:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658337.582055:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658337.582086:0:7629:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56fef6c800 from lustre-OST0001 10000000:01000000:2.0:1788658337.582115:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788658337.582118:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788658337.582127:0:7629:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e56c56c19c0 local copy 10000000:01000000:2.0:1788658337.582130:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788658337.582173:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.582186:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.582204:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658337.582242:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103729792:0@lo:101: 00000100:00100000:2.0:1788658337.582285:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.582350:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.582618:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729792 00000100:00100000:3.0:1788658337.582626:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729792 00000100:00100000:1.0:1788658337.582922:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658337.582936:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+11:7629:x1875544103729792:12345-0@lo:101: 00010000:00010000:1.0:1788658337.582950:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658337.582968:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1679a00/0xf657f176650ea987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea980 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.582996:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1679a00/0xf657f176650ea987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea980 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.583021:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1679a00/0xf657f176650ea987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea980 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.583031:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679a00, rc 0) 00000100:00100000:1.0:1788658337.583087:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103729792:12345-0@lo:101: Request processed in 154us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.583093:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788658337.583223:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103729792:0@lo:101: 00010000:00010000:3.0:1788658337.583252:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.583262:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.583391:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103729920:0@lo:501: 00000100:00100000:3.0:1788658337.583421:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658337.583462:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6ae0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658337.583586:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103729920 00000100:00100000:2.0:1788658337.583591:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103729920 00000100:00100000:2.0:1788658337.583630:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788658337.583639:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103729920:12345-0@lo:501: 00000100:00100000:2.0:1788658337.584276:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103729920:12345-0@lo:501: Request processed in 635us (851us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658337.584287:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658337.584462:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103729920:0@lo:501: 10000000:01000000:3.0:1788658337.584481:0:7629:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788658337.584515:0:7629:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788658337.584521:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.584531:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.584538:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.584565:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788658337.584587:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56fef6c800 10000000:01000000:3.0:1788658337.584592:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658337.584597:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788658337.584599:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658337.584604:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788658337.584607:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788658337.584644:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.584652:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.584824:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.584844:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730048:0@lo:101: 00000100:00100000:3.0:1788658337.584880:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658337.584907:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788658337.584961:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658337.584976:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.584983:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:1.0:1788658337.584994:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.585003:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658337.585024:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658337.585029:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658337.585051:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.585057:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658337.585085:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.585092:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc000/0xf657f176650ea980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf657f176650ea987 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.585105:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658337.585107:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658337.585109:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658337.585118:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658337.585129:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103730176:0@lo:103: 00000100:00100000:1.0:1788658337.585158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.585188:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730176 00000100:00100000:1.0:1788658337.585194:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730176 00000100:00100000:1.0:1788658337.585237:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658337.585246:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+12:3307:x1875544103730176:12345-0@lo:103: 00010000:00010000:1.0:1788658337.585257:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658337.585275:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679a00/0xf657f176650ea987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ea980 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.585291:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658337.585329:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+11:3307:x1875544103730176:12345-0@lo:103: Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.585336:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658337.585373:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103730176:0@lo:103: 00000100:00100000:2.0:1788658337.585537:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730048 00000100:00100000:2.0:1788658337.585542:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730048 00000100:00100000:2.0:1788658337.585574:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788658337.585581:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+11:7629:x1875544103730048:12345-0@lo:101: 00010000:00010000:2.0:1788658337.585591:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658337.585604:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea98e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.585621:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea98e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.585631:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea98e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.585638:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc800, rc 0) 00000100:00100000:3.0:1788658337.585896:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730048:0@lo:101: 00010000:00010000:3.0:1788658337.585911:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.585919:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658337.586292:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730048:12345-0@lo:101: Request processed in 710us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.586311:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658337.586408:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730304:0@lo:501: 00000100:00100000:3.0:1788658337.586445:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658337.586480:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658337.586832:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730304 00000100:00100000:1.0:1788658337.586838:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730304 00000100:00100000:1.0:1788658337.586879:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788658337.586889:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730304:12345-0@lo:501: 00000100:00100000:1.0:1788658337.588195:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730304:12345-0@lo:501: Request processed in 1302us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.588206:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658337.588317:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730304:0@lo:501: 00000100:00100000:3.0:1788658337.588376:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730432:0@lo:503: 00000100:00100000:3.0:1788658337.588424:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658337.588463:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658337.588648:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730432 00000100:00100000:2.0:1788658337.588655:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730432 00000100:00100000:2.0:1788658337.588789:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788658337.588798:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730432:12345-0@lo:503: 00000100:00100000:2.0:1788658337.588969:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730432:12345-0@lo:503: Request processed in 172us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.588975:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658337.589528:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730432:0@lo:503: 00000040:00080000:2.0:1788658337.590593:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658337.590791:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730560:0@lo:502: 00000100:00100000:2.0:1788658337.590871:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.590908:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658337.590983:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730560 00000100:00100000:1.0:1788658337.590992:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730560 00000100:00100000:1.0:1788658337.591049:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788658337.591059:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730560:12345-0@lo:502: 00000100:00100000:1.0:1788658337.591316:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730560:12345-0@lo:502: Request processed in 258us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.591324:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658337.597976:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730560:0@lo:502: 00000040:00080000:2.0:1788658337.600866:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788658337.600938:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788658337.600964:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788658337.601122:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788658337.601163:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788658337.601189:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788658337.601245:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730688:0@lo:502: 00000100:00100000:2.0:1788658337.601329:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.601448:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.604111:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730688 00000100:00100000:3.0:1788658337.604142:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730688 00000100:00100000:1.0:1788658337.608205:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788658337.608224:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730688:12345-0@lo:502: 00000100:00100000:1.0:1788658337.608564:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730688:12345-0@lo:502: Request processed in 345us (7233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.608575:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788658337.608738:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730688:0@lo:502: 00000040:00080000:3.0:1788658337.608923:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788658337.608941:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788658337.616196:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788658337.616210:0:7637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788658337.616217:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658337.616219:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788658337.616226:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658337.616242:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e56c644b380) 00000020:00000080:1.0:1788658337.616266:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788658337.616272:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788658337.616371:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56fef6c800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788658337.616380:0:7637:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788658337.616387:0:7637:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf657f176650ea9a3 00010000:00010000:0.0:1788658337.626887:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788658337.627349:0:7637:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788658337.632623:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788658337.633946:0:7637:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788658337.649903:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788658337.650453:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788658337.652591:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788658337.652603:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658337.652615:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658337.652618:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788658337.652622:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658337.652627:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658337.652628:0:7637:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658337.652632:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658337.652634:0:7637:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658337.654164:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658337.654172:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658337.654174:0:7637:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788658337.654179:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788658337.660956:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788658337.660998:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788658337.661193:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.661206:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658337.661311:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56fef6c800 from 1 10000000:01000000:1.0:1788658337.661315:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658337.661374:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.661383:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.661395:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658337.661426:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730816:0@lo:101: 00000100:00100000:1.0:1788658337.661508:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.661580:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c67dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.661644:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730816 00000100:00100000:3.0:1788658337.661696:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730816 00000100:00100000:3.0:1788658337.661761:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788658337.661771:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+12:7629:x1875544103730816:12345-0@lo:101: 00010000:00010000:3.0:1788658337.661785:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658337.661800:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea9aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.661823:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea9aa expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.661834:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9aa expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.661843:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9600, rc 0) 00000100:00100000:3.0:1788658337.661895:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103730816:12345-0@lo:101: Request processed in 125us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.661901:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658337.662281:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730816:0@lo:101: 00010000:00010000:0.0:1788658337.662300:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.662311:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658337.662461:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730944:0@lo:501: 00000100:00100000:0.0:1788658337.662496:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.662817:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658337.675177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103730944 00000100:00100000:1.0:1788658337.675193:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103730944 00000100:00100000:1.0:1788658337.675299:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788658337.675312:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103730944:12345-0@lo:501: 00000100:00100000:1.0:1788658337.675693:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103730944:12345-0@lo:501: Request processed in 383us (13195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.675722:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788658337.675827:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103730944:0@lo:501: 00000100:00100000:0.0:1788658337.675890:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731072:0@lo:503: 00000100:00100000:0.0:1788658337.675940:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.691961:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.694468:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731072 00000100:00100000:3.0:1788658337.694486:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731072 00000100:00100000:3.0:1788658337.697654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788658337.697697:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103731072:12345-0@lo:503: 00000100:00100000:3.0:1788658337.698173:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103731072:12345-0@lo:503: Request processed in 485us (22230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.698897:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731072:0@lo:503: 00000040:00080000:2.0:1788658337.699252:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658337.699336:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731200:0@lo:502: 00000100:00100000:2.0:1788658337.699409:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.699512:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.699623:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788658337.699915:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731200 00000100:00100000:3.0:1788658337.699923:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731200 00000100:00100000:1.0:1788658337.700001:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788658337.700132:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103731200:12345-0@lo:502: 00000100:00100000:2.0:1788658337.700402:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103731200:12345-0@lo:502: Request processed in 384us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.700410:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788658337.701552:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731200:0@lo:502: 00000040:00080000:0.0:1788658337.702170:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788658337.702250:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788658337.702307:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731328:0@lo:502: 00000100:00100000:0.0:1788658337.702388:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.702445:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788658337.702507:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731328 00000100:00100000:2.0:1788658337.702515:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731328 00000100:00100000:2.0:1788658337.702571:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788658337.702581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103731328:12345-0@lo:502: 00000100:00100000:2.0:1788658337.703098:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103731328:12345-0@lo:502: Request processed in 516us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.703107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788658337.703211:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731328:0@lo:502: 00000040:00080000:1.0:1788658337.703331:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788658337.703344:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788658337.704111:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658337.704122:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658337.704126:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658337.704132:0:7641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56fef6c800 00000020:00000080:1.0:1788658337.704134:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658337.704154:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658337.704158:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658337.704159:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788658337.704161:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788658337.704356:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788658337.704390:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658337.704425:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.704437:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658337.704484:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788658337.704487:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56fef6c800 10000000:01000000:2.0:1788658337.704491:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56fef6c800 10000000:01000000:2.0:1788658337.704495:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658337.704502:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56fef6c800 from 1 10000000:01000000:2.0:1788658337.704505:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658337.704544:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.704551:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.704562:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658337.704584:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731456:0@lo:101: 00000100:00100000:2.0:1788658337.704640:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.705001:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676240 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.705123:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731456 00000100:00100000:3.0:1788658337.705133:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731456 00000100:00100000:3.0:1788658337.705173:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788658337.705182:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103731456:12345-0@lo:101: 00010000:00010000:3.0:1788658337.705197:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658337.705212:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea9b8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.705237:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.705249:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.705258:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9200, rc 0) 00000100:00100000:3.0:1788658337.705306:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731456:12345-0@lo:101: Request processed in 125us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.705313:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788658337.705518:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731456:0@lo:101: 00010000:00010000:3.0:1788658337.705535:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.705545:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658337.705659:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731584:0@lo:501: 00000100:00100000:2.0:1788658337.707443:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.707504:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d09aae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658337.707564:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731584 00000100:00100000:1.0:1788658337.707574:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731584 00000100:00100000:1.0:1788658337.707636:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788658337.707647:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731584:12345-0@lo:501: 00000100:00100000:1.0:1788658337.708025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731584:12345-0@lo:501: Request processed in 377us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.708034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788658337.708095:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731584:0@lo:501: 00000100:00100000:1.0:1788658337.708157:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731712:0@lo:503: 00000100:00100000:1.0:1788658337.708200:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.708223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731712 00000100:00100000:1.0:1788658337.708228:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731712 00000100:00100000:1.0:1788658337.708254:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788658337.708260:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731712:12345-0@lo:503: 00000100:00100000:1.0:1788658337.708410:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731712:12345-0@lo:503: Request processed in 150us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.708416:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788658337.708445:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8104540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658337.708455:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731712:0@lo:503: 00000040:00080000:1.0:1788658337.708808:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658337.708892:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731840:0@lo:502: 00000100:00100000:1.0:1788658337.708930:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.708958:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731840 00000100:00100000:1.0:1788658337.708963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731840 00000100:00100000:1.0:1788658337.708983:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788658337.708989:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731840:12345-0@lo:502: 00000100:00100000:1.0:1788658337.709155:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731840:12345-0@lo:502: Request processed in 165us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.709163:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788658337.709194:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8104540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658337.709209:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731840:0@lo:502: 00000040:00080000:1.0:1788658337.709460:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788658337.709509:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788658337.709541:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788658337.709585:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788658337.709621:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788658337.709695:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788658337.709733:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788658337.709768:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788658337.709836:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788658337.709884:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788658337.709920:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788658337.709982:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788658337.710024:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788658337.710058:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788658337.710105:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788658337.710155:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788658337.710190:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788658337.710242:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788658337.710276:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788658337.710309:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788658337.716325:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788658337.716484:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788658337.716522:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788658337.716605:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788658337.716641:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788658337.717065:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788658337.717112:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788658337.717142:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788658337.717170:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788658337.717233:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788658337.717272:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788658337.717325:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788658337.717372:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788658337.717420:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788658337.717451:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788658337.717494:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788658337.717528:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788658337.717590:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731968:0@lo:502: 00000100:00100000:1.0:1788658337.718162:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.718293:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103731968 00000100:00100000:2.0:1788658337.718306:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103731968 00000100:00100000:2.0:1788658337.718415:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658337.718427:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731968:12345-0@lo:502: 00000100:00100000:2.0:1788658337.718747:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103731968:12345-0@lo:502: Request processed in 321us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.718755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658337.720298:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8104540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658337.720345:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103731968:0@lo:502: 00000040:00080000:2.0:1788658337.720512:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788658337.720528:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788658337.724900:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788658337.724919:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e56c6448000) 00000020:00000080:1.0:1788658337.724950:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788658337.725043:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56fef6c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788658337.725048:0:7642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56fef6c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788658337.725051:0:7642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56fef6c800 3 00010000:00080000:1.0:1788658337.725087:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56ff629800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1788658337.728571:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788658337.729225:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788658337.729265:0:7642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788658337.729280:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf657f176650ea9cd 00000100:00080000:2.0:1788658337.729295:0:7642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658337.729302:0:7642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e56ff629800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658337.729347:0:7642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56c5731c00 x1875544103732096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658337.729384:0:7642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788658337.729531:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658337.729552:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103732224:0@lo:400: 00000100:00100000:1.0:1788658337.729631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.729729:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103732352:0@lo:400: 00000100:00100000:1.0:1788658337.729757:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.729777:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658337.729783:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103732480:0@lo:400: 00000100:00100000:1.0:1788658337.729807:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.729843:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732224 00000100:00100000:1.0:1788658337.729852:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732224 00000100:00100000:1.0:1788658337.729896:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732352 00000100:00100000:1.0:1788658337.729899:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732352 00000100:00100000:1.0:1788658337.729931:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658337.729940:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103732224:12345-0@lo:400: 00000100:00100000:1.0:1788658337.730006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103732224:12345-0@lo:400: Request processed in 67us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.730014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658337.730030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658337.730036:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103732352:12345-0@lo:400: 00000100:00100000:1.0:1788658337.730082:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103732352:12345-0@lo:400: Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.730088:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658337.730110:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732480 00000100:00100000:1.0:1788658337.730119:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732480 00000100:00100000:1.0:1788658337.730150:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658337.730156:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103732480:12345-0@lo:400: 00000100:00100000:1.0:1788658337.730184:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103732480:12345-0@lo:400: Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.730189:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788658337.730207:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658337.730212:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658337.730244:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9f9880 x1875544103732224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658337.730259:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103732224:0@lo:400: 00010000:00080000:1.0:1788658337.730290:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9faa00 x1875544103732480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658337.730298:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103732480:0@lo:400: 00010000:00080000:1.0:1788658337.730306:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56de9fad80 x1875544103732352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658337.730312:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103732352:0@lo:400: 00000100:00100000:0.0:1788658337.730477:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103732096:0@lo:38: 00000100:00100000:0.0:1788658337.730518:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788658337.730891:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788658337.731047:0:7643:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9e56e5b0a680 x1875544103732608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658337.731058:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2c00 going to sleep for 0 seconds 00000020:01000000:2.0:1788658337.731288:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788658337.731323:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658337.731347:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.731367:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658337.731422:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658337.731424:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658337.731425:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658337.731426:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658337.731431:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658337.731432:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658337.731434:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658337.731435:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658337.731437:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658337.731438:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658337.731440:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658337.731445:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788658337.731447:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658337.731449:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658337.731450:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658337.731451:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658337.731451:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658337.731452:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658337.731453:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658337.731454:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658337.731455:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658337.731456:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658337.731457:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658337.731473:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788658337.731483:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103732736:0@lo:253: 00000100:00100000:2.0:1788658337.731536:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.731562:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658337.731864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732096 00000100:00100000:1.0:1788658337.731874:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732096 00000100:00100000:1.0:1788658337.731910:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658337.731918:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875544103732096:12345-0@lo:38: 00010000:00080000:1.0:1788658337.731944:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1788658337.731977:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf657f176650ea9d4 00000004:00100000:1.0:1788658337.731995:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788658337.732033:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9e56ff62b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658337.732103:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875544103732096:12345-0@lo:38: Request processed in 185us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.732110:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788658337.732153:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56c5731c00 x1875544103732096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658337.732162:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658337.732172:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788658337.732180:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788658337.732185:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658337.732187:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56ff629800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788658337.732193:0:3303:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000390eff1e): req@ffff9e56e5b0a680 x1875544103732608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658337.732209:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103732096:0@lo:38: 00000100:00100000:1.0:1788658337.732260:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.732339:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732736 00000100:00100000:0.0:1788658337.732344:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732736 00000100:00100000:0.0:1788658337.732384:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788658337.732390:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:7629:x1875544103732736:12345-0@lo:253: 20000000:01000000:0.0:1788658337.732425:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788658337.732440:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788658337.739133:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.739199:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732608 00000100:00100000:3.0:1788658337.739218:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732608 00000100:00100000:3.0:1788658337.739297:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658337.739308:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1875544103732608:12345-0@lo:901: 00000100:00100000:3.0:1788658337.739865:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1875544103732608:12345-0@lo:901: Request processed in 555us (7601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.739875:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788658337.740059:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658337.740102:0:7643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56e5b0a680 x1875544103732608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788658353 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658337.740119:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1875544103732608:0@lo:901: 20000000:01000000:3.0:1788658337.793282:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658337.793304:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788658337.793394:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788658337.793399:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788658337.793424:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.793444:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea925 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.793452:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.793513:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea925 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.793529:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea925 expref: 14 pid: 5832 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658337.793546:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875544103732864:0@lo:104: 00000100:00100000:1.0:1788658337.793621:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.793714:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8104240 going to sleep for 11 seconds 00000100:00100000:3.0:1788658337.794137:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732864 00000100:00100000:3.0:1788658337.794147:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732864 00000100:00100000:3.0:1788658337.794198:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658337.794208:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:5853:x1875544103732864:12345-0@lo:104: 00010000:00010000:3.0:1788658337.794222:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658337.794286:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788658337.794293:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:5853:x1875544103732864:12345-0@lo:104: Request processed in 87us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.794300:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658337.794438:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9faa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875544103732864:0@lo:104: 00010000:00010000:1.0:1788658337.794462:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.796011:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658337.796023:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.796033:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfe00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658337.796037:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.796047:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658337.796055:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658337.796061:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658337.796106:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.796130:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658337.796154:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.796162:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c29dfe00/0xf657f176650ea925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea92c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658337.796180:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658337.796182:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658337.796184:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658337.796192:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658337.796214:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103732992:0@lo:103: 00000100:00100000:0.0:1788658337.796277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658337.797472:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103732992 00000100:00100000:1.0:1788658337.797485:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103732992 00010000:00010000:1.0:1788658337.797524:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea925 expref: 15 pid: 5832 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658337.797561:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658337.797572:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8936050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+15:3307:x1875544103732992:12345-0@lo:103: 00010000:00010000:1.0:1788658337.797586:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658337.797591:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea925 expref: 15 pid: 5832 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797603:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea925 expref: 15 pid: 5832 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797619:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d9800/0xf657f176650ea92c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea925 expref: 15 pid: 5832 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797648:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797657:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788658337.797771:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004371848s 00010000:00010000:1.0:1788658337.797776:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797784:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797792:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797798:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797803:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658337.797807:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797815:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797830:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.797841:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658337.797909:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8936050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+14:3307:x1875544103732992:12345-0@lo:103: Request processed in 339us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.797916:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658337.797992:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103732992:0@lo:103: 00010000:00010000:1.0:1788658337.798034:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.798043:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.798049:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678800/0xf657f176650ea9db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658337.810150:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:7629:x1875544103732736:12345-0@lo:253: Request processed in 77751us (78604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.810165:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788658337.810400:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5730380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88ab4306-42c5-43ae-b202-256d86278024:7629:1875544103732736:0@lo:253: 10000000:01000000:3.0:1788658337.810420:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788658337.810423:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658337.810425:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788658337.810426:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658337.810427:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658337.810428:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658337.810429:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658337.810430:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658337.810432:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658337.810433:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658337.810435:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658337.810449:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788658337.810474:0:7629:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788658337.814556:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658337.815110:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658337.815345:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658337.815527:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658337.815835:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658337.816081:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788658337.817777:0:7629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788658338.066713:0:7629:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788658338.066724:0:7629:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788658338.066762:0:7629:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658338.066862:0:7629:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658338.066878:0:7629:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788658338.066909:0:7629:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788658338.526244:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658339.548964:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658340.572908:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658340.765023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103733120:0@lo:13: 00000100:00100000:0.0:1788658340.765101:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658340.765210:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103733120 00000100:00100000:1.0:1788658340.765220:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103733120 00000100:00080000:0.0:1788658340.765736:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658340.765739:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658340.765750:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103733120:12345-0@lo:13: 00002000:00000024:1.0:1788658340.765809:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658340.765867:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103733120:12345-0@lo:13: Request processed in 118us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658340.765875:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788658340.765895:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56de9fbb80 x1875544103733120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658340.765916:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103733120:0@lo:13: 00010000:00010000:0.0:1788658341.602707:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658342.620772:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658342.815851:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103733248:0@lo:400: 00000100:00100000:1.0:1788658342.815934:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.815985:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103733760:0@lo:400: 00000100:00100000:1.0:1788658342.816011:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.816047:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658342.816054:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103733376:0@lo:400: 00000100:00100000:1.0:1788658342.816074:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.816107:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103733248 00000100:00100000:1.0:1788658342.816115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103733248 00000100:00100000:1.0:1788658342.816167:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788658342.816176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:3304:x1875544103733248:12345-0@lo:400: 00000100:00100000:1.0:1788658342.816230:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:3304:x1875544103733248:12345-0@lo:400: Request processed in 55us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.816237:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788658342.816271:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103733760 00000100:00100000:1.0:1788658342.816275:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103733760 00000100:00100000:1.0:1788658342.816308:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103733376 00000100:00100000:1.0:1788658342.816311:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103733376 00000100:00100000:1.0:1788658342.816328:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658342.816334:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103733760:12345-0@lo:400: 00000100:00100000:1.0:1788658342.816365:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103733760:12345-0@lo:400: Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.816371:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658342.816382:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658342.816387:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103733376:12345-0@lo:400: 00000100:00100000:1.0:1788658342.816410:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103733376:12345-0@lo:400: Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.816416:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788658342.816436:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658342.816472:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bdf80 x1875544103733376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658342.816486:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103733376:0@lo:400: 00000100:00100000:1.0:1788658342.816505:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103733248:0@lo:400: 00010000:00080000:1.0:1788658342.816525:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bea00 x1875544103733760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658342.816534:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103733760:0@lo:400: 00000100:00100000:1.0:1788658342.817223:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103733504:0@lo:400: 00000100:00100000:1.0:1788658342.817258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.817282:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658342.817289:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103733632:0@lo:400: 00000100:00100000:1.0:1788658342.817314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.818805:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103733504 00000100:00100000:1.0:1788658342.818817:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103733504 00000100:00100000:1.0:1788658342.818887:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658342.818896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103733504:12345-0@lo:400: 00000100:00100000:1.0:1788658342.818965:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103733504:12345-0@lo:400: Request processed in 70us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.818973:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788658342.819016:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bd500 x1875544103733504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658342.819031:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103733504:0@lo:400: 00000100:00100000:3.0:1788658342.819107:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103733632 00000100:00100000:3.0:1788658342.819112:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103733632 00000100:00100000:3.0:1788658342.819148:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658342.819156:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103733632:12345-0@lo:400: 00000100:00100000:3.0:1788658342.819195:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103733632:12345-0@lo:400: Request processed in 41us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.819202:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788658342.820723:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bf800 x1875544103733632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658342.820739:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103733632:0@lo:400: 00000100:00080000:2.0:1788658342.821144:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658342.821150:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788658343.653362:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658344.209366:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788658344.669164:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658345.697240:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658345.885160:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103733888:0@lo:13: 00000100:00100000:2.0:1788658345.885245:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658345.885362:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103733888 00000100:00100000:0.0:1788658345.885372:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103733888 00000100:00100000:0.0:1788658345.885444:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658345.885454:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103733888:12345-0@lo:13: 00002000:00000024:0.0:1788658345.885492:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788658345.885631:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658345.886490:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103733888:12345-0@lo:13: Request processed in 1033us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658345.886518:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788658345.891988:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56de9fa300 x1875544103733888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658345.892022:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103733888:0@lo:13: 10000000:01000000:0.0:1788658346.396979:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788658346.396986:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e57014ee800 from 30 10000000:01000000:0.0:1788658346.396991:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658346.397047:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.397059:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.397070:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658346.397101:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734016:0@lo:101: 00000100:00100000:0.0:1788658346.397177:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.397250:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.397361:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734016 00000100:00100000:2.0:1788658346.397371:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734016 00000100:00100000:2.0:1788658346.397434:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788658346.397445:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103734016:12345-0@lo:101: 00010000:00010000:2.0:1788658346.397458:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658346.397472:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea9e2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.397496:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.397507:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.397515:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd400, rc 0) 00000100:00100000:2.0:1788658346.397567:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103734016:12345-0@lo:101: Request processed in 123us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.397590:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788658346.397707:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734016:0@lo:101: 00010000:00010000:0.0:1788658346.397723:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.397732:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658346.397790:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734144:0@lo:501: 00000100:00100000:0.0:1788658346.397817:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.397849:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.400523:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734144 00000100:00100000:2.0:1788658346.400540:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734144 00000100:00100000:2.0:1788658346.400623:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788658346.400646:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103734144:12345-0@lo:501: 00000100:00100000:2.0:1788658346.401142:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103734144:12345-0@lo:501: Request processed in 497us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.401152:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788658346.401763:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734144:0@lo:501: 00000100:00100000:0.0:1788658346.401824:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734272:0@lo:503: 00000100:00100000:0.0:1788658346.401898:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.401946:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.403204:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734272 00000100:00100000:2.0:1788658346.403216:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734272 00000100:00100000:2.0:1788658346.403280:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788658346.403290:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103734272:12345-0@lo:503: 00000100:00100000:2.0:1788658346.403815:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103734272:12345-0@lo:503: Request processed in 525us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.403825:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788658346.404411:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734272:0@lo:503: 00000100:00100000:0.0:1788658346.404838:0:8090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8090:1875544103734400:0@lo:502: 00000100:00100000:0.0:1788658346.404896:0:8090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.404944:0:8090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.405015:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734400 00000100:00100000:1.0:1788658346.405022:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734400 00000100:00100000:1.0:1788658346.405073:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788658346.405083:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:8090:x1875544103734400:12345-0@lo:502: 00000100:00100000:1.0:1788658346.405373:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:8090:x1875544103734400:12345-0@lo:502: Request processed in 290us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.405382:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788658346.405556:0:8090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8090:1875544103734400:0@lo:502: 00000100:00100000:0.0:1788658346.405621:0:8090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8090:1875544103734528:0@lo:502: 00000100:00100000:0.0:1788658346.405702:0:8090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.405733:0:8090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c95f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658346.405790:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734528 00000100:00100000:3.0:1788658346.405794:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734528 00000100:00100000:3.0:1788658346.405830:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788658346.405839:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:8090:x1875544103734528:12345-0@lo:502: 00000100:00100000:3.0:1788658346.405992:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:8090:x1875544103734528:12345-0@lo:502: Request processed in 154us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658346.406000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788658346.406821:0:8090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8090:1875544103734528:0@lo:502: 00000040:00080000:0.0:1788658346.406857:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788658346.407091:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788658346.407111:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658346.407124:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658346.407135:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658346.407145:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788658346.407148:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788658346.407161:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788658346.407195:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658346.407203:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658346.407213:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658346.407231:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734656:0@lo:101: 00000100:00100000:3.0:1788658346.407276:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.407327:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.407460:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734656 00000100:00100000:2.0:1788658346.407467:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734656 00000100:00100000:2.0:1788658346.407512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788658346.407522:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103734656:12345-0@lo:101: 00010000:00010000:2.0:1788658346.407533:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658346.407546:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea9f0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.407572:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.407598:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.407617:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd200, rc 0) 00000100:00100000:2.0:1788658346.407706:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103734656:12345-0@lo:101: Request processed in 185us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.407875:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658346.407953:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734656:0@lo:101: 00010000:00010000:3.0:1788658346.407968:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658346.407977:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658346.408030:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734784:0@lo:501: 00000100:00100000:3.0:1788658346.408059:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.408090:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.408311:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734784 00000100:00100000:2.0:1788658346.408315:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734784 00000100:00100000:2.0:1788658346.408384:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788658346.408392:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103734784:12345-0@lo:501: 00000100:00100000:2.0:1788658346.408689:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103734784:12345-0@lo:501: Request processed in 298us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.408696:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788658346.408766:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734784:0@lo:501: 00000100:00100000:3.0:1788658346.408792:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734912:0@lo:503: 00000100:00100000:3.0:1788658346.408824:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.410829:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.411278:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103734912 00000100:00100000:1.0:1788658346.411289:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103734912 00000100:00100000:1.0:1788658346.411354:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788658346.411363:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103734912:12345-0@lo:503: 00000100:00100000:1.0:1788658346.411816:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103734912:12345-0@lo:503: Request processed in 453us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.411824:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788658346.411892:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103734912:0@lo:503: 00000100:00100000:1.0:1788658346.412143:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8091:1875544103735040:0@lo:502: 00000100:00100000:1.0:1788658346.412176:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.412193:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735040 00000100:00100000:1.0:1788658346.412196:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735040 00000100:00100000:1.0:1788658346.412211:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788658346.412217:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8091:x1875544103735040:12345-0@lo:502: 00000100:00100000:1.0:1788658346.412371:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8091:x1875544103735040:12345-0@lo:502: Request processed in 154us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.412378:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788658346.412402:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.412411:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8091:1875544103735040:0@lo:502: 00000020:01000000:1.0:1788658346.412434:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658346.412442:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658346.412444:0:8091:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788658346.412448:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788658346.412449:0:8091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788658346.412459:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8091:1875544103735168:0@lo:502: 00000100:00100000:1.0:1788658346.412480:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.412492:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735168 00000100:00100000:1.0:1788658346.412495:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735168 00000100:00100000:1.0:1788658346.412505:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788658346.412509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8091:x1875544103735168:12345-0@lo:502: 00000100:00100000:1.0:1788658346.412577:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8091:x1875544103735168:12345-0@lo:502: Request processed in 67us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.412581:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788658346.412600:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.412607:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8091:1875544103735168:0@lo:502: 00000020:01000000:1.0:1788658346.412619:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658346.412622:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658346.412623:0:8091:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788658346.412638:0:8091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788658346.412714:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788658346.412730:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788658346.412741:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658346.412755:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658346.412765:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788658346.412773:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56f44c2000 from 30 10000000:01000000:1.0:1788658346.412776:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658346.412800:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658346.412808:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658346.412821:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658346.412833:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735296:0@lo:101: 00000100:00100000:1.0:1788658346.412858:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.413193:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.416824:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735296 00000100:00100000:0.0:1788658346.416840:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735296 00000100:00100000:0.0:1788658346.416903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788658346.416911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103735296:12345-0@lo:101: 00010000:00010000:0.0:1788658346.416926:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658346.416943:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ea9fe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.416974:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ea9fe expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.416986:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9fe expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.416996:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c0031e00, rc 0) 00000100:00100000:0.0:1788658346.417131:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103735296:12345-0@lo:101: Request processed in 220us (4272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.417136:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788658346.417329:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735296:0@lo:101: 00010000:00010000:1.0:1788658346.417351:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658346.417362:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658346.417438:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735424:0@lo:501: 00000100:00100000:1.0:1788658346.417473:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.417511:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.417558:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735424 00000100:00100000:0.0:1788658346.417561:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735424 00000100:00100000:0.0:1788658346.417581:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658346.417588:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103735424:12345-0@lo:501: 00000100:00100000:0.0:1788658346.417915:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103735424:12345-0@lo:501: Request processed in 327us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.417922:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788658346.418014:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735424:0@lo:501: 00000100:00100000:1.0:1788658346.418046:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735552:0@lo:503: 00000100:00100000:1.0:1788658346.418084:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.418102:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.418413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735552 00000100:00100000:0.0:1788658346.418418:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735552 00000100:00100000:0.0:1788658346.418441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788658346.418447:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103735552:12345-0@lo:503: 00000100:00100000:0.0:1788658346.418766:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103735552:12345-0@lo:503: Request processed in 317us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.418774:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788658346.419058:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735552:0@lo:503: 00000100:00100000:3.0:1788658346.419498:0:8092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8092:1875544103735680:0@lo:502: 00000100:00100000:3.0:1788658346.419554:0:8092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.419711:0:8092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.419946:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735680 00000100:00100000:1.0:1788658346.419952:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735680 00000100:00100000:1.0:1788658346.420018:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788658346.420027:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:8092:x1875544103735680:12345-0@lo:502: 00000100:00100000:1.0:1788658346.420250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:8092:x1875544103735680:12345-0@lo:502: Request processed in 223us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.420258:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788658346.420339:0:8092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8092:1875544103735680:0@lo:502: 00000100:00100000:3.0:1788658346.420387:0:8092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8092:1875544103735808:0@lo:502: 00000100:00100000:3.0:1788658346.420420:0:8092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.420703:0:8092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.420762:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735808 00000100:00100000:0.0:1788658346.420767:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735808 00000100:00100000:1.0:1788658346.420858:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788658346.420866:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:8092:x1875544103735808:12345-0@lo:502: 00000100:00100000:1.0:1788658346.421006:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:8092:x1875544103735808:12345-0@lo:502: Request processed in 141us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.421013:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788658346.421080:0:8092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8092:1875544103735808:0@lo:502: 00000040:00080000:3.0:1788658346.421102:0:8092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788658346.421751:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788658346.421773:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658346.421783:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.421795:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658346.421805:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788658346.421807:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56f44c2000 from 5 10000000:01000000:0.0:1788658346.421818:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788658346.421851:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.421860:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.421870:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658346.421887:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735936:0@lo:101: 00000100:00100000:0.0:1788658346.421927:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.421952:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.421966:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103735936 00000100:00100000:0.0:1788658346.421970:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103735936 00000100:00100000:0.0:1788658346.421994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788658346.422002:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103735936:12345-0@lo:101: 00010000:00010000:0.0:1788658346.422011:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658346.422025:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c0030e00/0xf657f176650eaa13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaa0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422050:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c0030e00/0xf657f176650eaa13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaa0c expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422060:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c0030e00/0xf657f176650eaa13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaa0c expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422068:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c0030e00, rc 0) 00000100:00100000:0.0:1788658346.422100:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103735936:12345-0@lo:101: Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.422114:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788658346.422148:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103735936:0@lo:101: 00010000:00010000:0.0:1788658346.422161:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422170:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658346.422214:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736064:0@lo:256: 00000100:00100000:0.0:1788658346.422247:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.422260:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.422271:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736064 00000100:00100000:0.0:1788658346.422274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736064 00000100:00100000:0.0:1788658346.422291:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788658346.422297:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103736064:12345-0@lo:256: 20000000:01000000:0.0:1788658346.422310:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658346.422328:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658346.422331:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788658346.422407:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103736064:12345-0@lo:256: Request processed in 109us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.422413:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788658346.422439:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736064:0@lo:256: 10000000:01000000:0.0:1788658346.422475:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658346.422481:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422489:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658346.422502:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788658346.422503:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788658346.422506:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788658346.422519:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422528:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422534:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658346.422544:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736192:0@lo:101: 00000100:00100000:0.0:1788658346.422567:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.422579:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.422589:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736192 00000100:00100000:0.0:1788658346.422592:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736192 00000100:00100000:0.0:1788658346.422607:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788658346.422612:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103736192:12345-0@lo:101: 00010000:00010000:0.0:1788658346.422619:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658346.422881:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaa1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422900:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaa1a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422910:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaa1a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658346.422928:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c0031000, rc 0) 00000100:00100000:0.0:1788658346.423001:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103736192:12345-0@lo:101: Request processed in 388us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.423007:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788658346.423203:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736192:0@lo:101: 00010000:00010000:2.0:1788658346.423216:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.423225:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658346.423340:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736320:0@lo:501: 00000100:00100000:1.0:1788658346.423370:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.423434:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.423473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736320 00000100:00100000:2.0:1788658346.423478:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736320 00000100:00100000:1.0:1788658346.423597:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788658346.423604:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103736320:12345-0@lo:501: 00000100:00100000:1.0:1788658346.423919:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103736320:12345-0@lo:501: Request processed in 315us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.423927:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788658346.423994:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736320:0@lo:501: 00000100:00100000:2.0:1788658346.424025:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736448:0@lo:503: 00000100:00100000:2.0:1788658346.424063:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.424413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736448 00000100:00100000:0.0:1788658346.424418:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736448 00000100:00100000:0.0:1788658346.424444:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658346.424451:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103736448:12345-0@lo:503: 00000100:00100000:0.0:1788658346.425172:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103736448:12345-0@lo:503: Request processed in 718us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.425181:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788658346.425544:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.425567:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103736448:0@lo:503: 00000100:00100000:2.0:1788658346.426222:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8093:1875544103736576:0@lo:502: 00000100:00100000:2.0:1788658346.426281:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658346.426317:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.426446:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736576 00000100:00100000:0.0:1788658346.426452:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736576 00000100:00100000:0.0:1788658346.426494:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788658346.426503:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:8093:x1875544103736576:12345-0@lo:502: 00000100:00100000:0.0:1788658346.426835:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:8093:x1875544103736576:12345-0@lo:502: Request processed in 332us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.426843:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788658346.426972:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8093:1875544103736576:0@lo:502: 00000020:01000000:2.0:1788658346.427003:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658346.427012:0:8093:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788658346.427019:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658346.427022:0:8093:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788658346.427027:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788658346.427031:0:8093:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:2.0:1788658346.427056:0:8093:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788658346.427060:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658346.427073:0:8093:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e56c83e19c0) 00000020:00000080:2.0:1788658346.427094:0:8093:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788658346.427098:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788658346.427162:0:8093:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788658346.427168:0:8093:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788658346.427174:0:8093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650eaa2f 00010000:00080000:2.0:1788658346.427219:0:8093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e57007b9800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1788658346.427452:0:8093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788658346.427840:0:8093:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788658346.427854:0:8093:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788658346.429979:0:8093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658346.430323:0:8093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658346.430382:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788658346.430445:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788658346.434850:0:8094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658346.434859:0:8094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788658346.435754:0:8093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658346.435769:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788658346.435803:0:8093:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788658346.435827:0:8093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650eaa36 00000100:00080000:3.0:1788658346.435839:0:8093:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658346.435845:0:8093:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e57007b9800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658346.435887:0:8093:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57014bd500 x1875544103736704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658346.435911:0:8093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788658346.435964:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658346.435969:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658346.435971:0:8093:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788658346.435974:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658346.435977:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658346.435978:0:8093:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788658346.435981:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788658346.435983:0:8093:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788658346.436015:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8093:1875544103736832:0@lo:502: 00000100:00100000:3.0:1788658346.436099:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.436151:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.436283:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658346.436295:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103737216:0@lo:400: 00000100:00100000:2.0:1788658346.436341:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.436442:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103736704:0@lo:8: 00000100:00100000:1.0:1788658346.436477:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.436524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737216 00000100:00100000:1.0:1788658346.436533:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737216 00000100:00100000:1.0:1788658346.436591:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658346.436600:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103737216:12345-0@lo:400: 00000100:00100000:1.0:1788658346.436688:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103737216:12345-0@lo:400: Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658346.436696:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788658346.436719:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658346.436755:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c5733100 x1875544103737216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658346.436771:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103737216:0@lo:400: 00000100:00100000:2.0:1788658346.436835:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736704 00000100:00100000:2.0:1788658346.436839:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736704 00000100:00100000:2.0:1788658346.436871:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658346.436877:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103736704:12345-0@lo:8: 00010000:00080000:2.0:1788658346.436900:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1788658346.436927:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650eaa3d 00002000:00100000:2.0:1788658346.436942:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e57007bf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788658346.436946:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788658346.436951:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788658346.437088:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788658346.437239:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788658346.437269:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9e57007ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658346.437312:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875544103736704:12345-0@lo:8: Request processed in 433us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.437318:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658346.437409:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103736960:0@lo:400: 00000100:00100000:3.0:1788658346.437439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.437461:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658346.437467:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103737088:0@lo:400: 00000100:00100000:3.0:1788658346.437488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.437515:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736960 00000100:00100000:3.0:1788658346.437520:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736960 00000100:00100000:3.0:1788658346.437546:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737088 00000100:00100000:3.0:1788658346.437550:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737088 00000100:00100000:3.0:1788658346.437575:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658346.437581:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103736960:12345-0@lo:400: 00000100:00100000:3.0:1788658346.437620:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103736960:12345-0@lo:400: Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658346.437644:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658346.437658:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658346.437683:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103737088:12345-0@lo:400: 00000100:00100000:3.0:1788658346.437714:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103737088:12345-0@lo:400: Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658346.437720:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788658346.437749:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c5731f80 x1875544103737088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658346.437759:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103737088:0@lo:400: 00010000:00080000:3.0:1788658346.437769:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c5732a00 x1875544103736960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658346.437778:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103736960:0@lo:400: 00000100:00080000:3.0:1788658346.437814:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658346.438096:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bd500 x1875544103736704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658346.438106:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658346.438114:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788658346.438123:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788658346.438130:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788658346.438132:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e57007b9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788658346.438157:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788658346.438164:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103736704:0@lo:8: 00000004:00080000:1.0:1788658346.438186:0:8094:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788658346.438318:0:8094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 237577651343ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788658346.438952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103736832 00000100:00100000:2.0:1788658346.438961:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103736832 00000100:00100000:2.0:1788658346.439000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788658346.439008:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:8093:x1875544103736832:12345-0@lo:502: 00000100:00100000:2.0:1788658346.439280:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:8093:x1875544103736832:12345-0@lo:502: Request processed in 271us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.439288:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788658346.442843:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8093:1875544103736832:0@lo:502: 00000020:01000000:3.0:1788658346.442895:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658346.442903:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658346.442906:0:8093:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788658346.442911:0:8093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788658346.443337:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788658346.443375:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788658346.443386:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658346.443409:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658346.443641:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788658346.443644:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e56c56c19c0 from 1 10000000:01000000:1.0:1788658346.443647:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788658346.443716:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658346.443724:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658346.443734:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658346.443763:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103737344:0@lo:101: 00000100:00100000:1.0:1788658346.443834:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.443934:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c56776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658346.443972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737344 00000100:00100000:3.0:1788658346.443980:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737344 00000100:00100000:3.0:1788658346.444074:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788658346.444086:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103737344:12345-0@lo:101: 00010000:00010000:3.0:1788658346.444101:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658346.444117:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaa44 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658346.444149:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaa44 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658346.444159:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaa44 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658346.444167:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9c00, rc 0) 00000100:00100000:3.0:1788658346.444224:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103737344:12345-0@lo:101: Request processed in 140us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658346.444231:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788658346.444312:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103737344:0@lo:101: 00010000:00010000:2.0:1788658346.444327:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.444337:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658346.444412:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103737472:0@lo:501: 00000100:00100000:2.0:1788658346.444442:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658346.444538:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d54bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.444568:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737472 00000100:00100000:1.0:1788658346.444572:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737472 00000100:00100000:1.0:1788658346.444597:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788658346.444605:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103737472:12345-0@lo:501: 00000100:00100000:1.0:1788658346.444891:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103737472:12345-0@lo:501: Request processed in 286us (446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658346.444900:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788658346.445042:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103737472:0@lo:501: 10000000:01000000:2.0:1788658346.445066:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788658346.445074:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658346.445083:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658346.494518:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788658346.521334:0:8095:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788658346.521375:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103737728:0@lo:7: 00000100:00100000:3.0:1788658346.521462:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.521533:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d54bb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.521758:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103737600:0@lo:13: 00000100:00100000:1.0:1788658346.521797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658346.521860:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737728 00000100:00100000:1.0:1788658346.521870:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737728 00000100:00100000:1.0:1788658346.521955:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658346.521965:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8095:x1875544103737728:12345-0@lo:7: 00000100:00100000:3.0:1788658346.524978:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737600 00000100:00100000:3.0:1788658346.524991:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737600 00000100:00100000:3.0:1788658346.525051:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658346.525061:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103737600:12345-0@lo:13: 00002000:00000024:3.0:1788658346.525094:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788658346.525189:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103737600:12345-0@lo:13: Request processed in 130us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658346.525195:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788658346.525731:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658346.525783:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bea00 x1875544103737600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658346.525810:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103737600:0@lo:13: 00002000:00080000:0.0:1788658346.529932:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788658346.529958:0:6686:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788658346.530069:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8095:x1875544103737728:12345-0@lo:7: Request processed in 8099us (8601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658346.530082:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788658346.530275:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bd180 x1875544103737728/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658346.530293:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103737728:0@lo:7: 00000004:00080000:3.0:1788658346.530318:0:8095:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788658346.530362:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103737856:0@lo:5: 00000100:00100000:3.0:1788658346.530398:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658346.530460:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d54bb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658346.530786:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737856 00000100:00100000:1.0:1788658346.530795:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737856 00000100:00100000:1.0:1788658346.530884:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658346.530894:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8095:x1875544103737856:12345-0@lo:5: 00002000:00080000:1.0:1788658346.530921:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788658346.530925:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788658346.531204:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8095:x1875544103737856:12345-0@lo:5: Request processed in 310us (804us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788658346.531211:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788658346.531405:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bd180 x1875544103737856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658346.531419:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103737856:0@lo:5: 00000004:00080000:0.0:1788658346.531442:0:8095:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788658346.531471:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103737984:0@lo:700: 00000100:00100000:0.0:1788658346.531502:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.531524:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.532711:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103737984 00000100:00100000:0.0:1788658346.532723:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103737984 00000100:00100000:0.0:1788658346.532781:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658346.532789:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8095:x1875544103737984:12345-0@lo:700: 00000100:00100000:0.0:1788658346.532838:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6693:1875544103738112:0@lo:700: 00000100:00100000:0.0:1788658346.532881:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658346.532915:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658346.533126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103738112 00000100:00100000:2.0:1788658346.533131:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103738112 00000100:00100000:2.0:1788658346.533169:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658346.533176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6693:x1875544103738112:12345-0@lo:700: 40000000:02000000:2.0:1788658346.587034:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788658346.593827:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6693:x1875544103738112:12345-0@lo:700: Request processed in 60641us (60935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.593843:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788658346.595026:0:6693:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b0a300 x1875544103738112/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788658362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658346.595046:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6693:1875544103738112:0@lo:700: 40000000:02000000:0.0:1788658346.595066:0:6693:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788658346.705657:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8095:x1875544103737984:12345-0@lo:700: Request processed in 172844us (174130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.705714:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1788658346.705827:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788658346.705842:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788658346.705941:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b09c00 x1875544103737984/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788658362 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658346.706088:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103737984:0@lo:700: 00010000:00010000:1.0:1788658346.717196:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:2.0:1788658346.751866:0:8095:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788658346.760936:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103738240:0@lo:5: 00000100:00100000:2.0:1788658346.761612:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658346.761775:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658346.762989:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103738240 00000100:00100000:0.0:1788658346.763002:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103738240 00000100:00100000:0.0:1788658346.763086:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658346.763102:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8095:x1875544103738240:12345-0@lo:5: 00002000:00080000:2.0:1788658346.772740:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788658346.772763:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788658346.777163:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8095:x1875544103738240:12345-0@lo:5: Request processed in 14055us (15544us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788658346.777178:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788658346.777326:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c5730a80 x1875544103738240/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658362 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658346.777343:0:8095:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788658346.777361:0:8095:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e56c5730a80 x1875544103738240/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658362 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658346.777375:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1875544103738240:0@lo:5: 00000004:00080000:2.0:1788658346.777393:0:8095:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788658347.741951:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658348.764991:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788658349.127609:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788658349.788791:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658349.794930:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658349.795011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076451968 00000100:00100000:2.0:1788658349.795024:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076451968 00000100:00100000:2.0:1788658349.795087:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 111 00000100:00100000:2.0:1788658349.795096:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1875544076451968:12345-192.168.202.3@tcp:250: 00010000:00080000:2.0:1788658349.795127:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f5e2ec63-51f5-4911-9a1f-c6731fda8201@192.168.202.3@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1788658349.795303:0:5832:0:(genops.c:1385:class_connect()) connect: client f5e2ec63-51f5-4911-9a1f-c6731fda8201, cookie 0xf657f176650eaa52 00000100:00080000:2.0:1788658349.795446:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9e57007bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658349.795634:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+5:2350:x1875544076451968:12345-192.168.202.3@tcp:250: Request processed in 536us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658349.795656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 111 00000100:00100000:1.0:1788658349.806153:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658349.806426:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452096 00000100:00100000:2.0:1788658349.806437:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452096 00000100:00100000:2.0:1788658349.806486:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 112 00000100:00100000:2.0:1788658349.806496:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+5:5578:x1875544076452096:12345-192.168.202.3@tcp:101: 00010000:00010000:2.0:1788658349.806513:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658349.806531:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ac36 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658349.806559:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658349.806571:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658349.806580:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc200, rc 0) 00000100:00100000:2.0:1788658349.806651:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+6:5578:x1875544076452096:12345-192.168.202.3@tcp:101: Request processed in 156us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658349.806658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 112 00000100:00100000:3.0:1788658349.808557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658349.808831:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452224 00000100:00100000:2.0:1788658349.808845:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452224 00000100:00100000:2.0:1788658349.808895:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:2.0:1788658349.808904:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+6:5578:x1875544076452224:12345-192.168.202.3@tcp:501: 00000100:00100000:2.0:1788658349.809478:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+6:5578:x1875544076452224:12345-192.168.202.3@tcp:501: Request processed in 571us (925us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658349.809489:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:1.0:1788658349.825906:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658349.826101:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452352 00000100:00100000:3.0:1788658349.826116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452352 00000100:00100000:3.0:1788658349.826177:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:3.0:1788658349.826186:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+6:5578:x1875544076452352:12345-192.168.202.3@tcp:101: 00010000:00010000:3.0:1788658349.826203:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658349.826235:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ac3d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658349.826266:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658349.826278:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658349.826288:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c0030000, rc 0) 00000100:00100000:3.0:1788658349.826362:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+7:5578:x1875544076452352:12345-192.168.202.3@tcp:101: Request processed in 175us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658349.826369:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:0.0:1788658349.833031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658349.833216:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452480 00000100:00100000:2.0:1788658349.833235:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452480 00000100:00100000:2.0:1788658349.833417:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:2.0:1788658349.833429:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+7:5578:x1875544076452480:12345-192.168.202.3@tcp:501: 00000100:00100000:2.0:1788658349.833893:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5578:x1875544076452480:12345-192.168.202.3@tcp:501: Request processed in 464us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658349.833902:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:3.0:1788658349.837065:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658349.837338:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452608 00000100:00100000:1.0:1788658349.837352:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452608 00000100:00100000:1.0:1788658349.837455:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:1.0:1788658349.837468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5578:x1875544076452608:12345-192.168.202.3@tcp:503: 00000100:00100000:1.0:1788658349.837927:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5578:x1875544076452608:12345-192.168.202.3@tcp:503: Request processed in 459us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658349.837936:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:1.0:1788658349.855815:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658349.856656:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452736 00000100:00100000:2.0:1788658349.865154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452736 00000100:00100000:3.0:1788658349.865404:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:3.0:1788658349.865415:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5597:x1875544076452736:12345-192.168.202.3@tcp:502: 00000100:00100000:3.0:1788658349.865977:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5597:x1875544076452736:12345-192.168.202.3@tcp:502: Request processed in 561us (10170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658349.865986:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:0.0:1788658349.889993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658349.890103:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452864 00000100:00100000:1.0:1788658349.890118:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452864 00000100:00100000:1.0:1788658349.890198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:1.0:1788658349.890208:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5597:x1875544076452864:12345-192.168.202.3@tcp:502: 00000100:00100000:1.0:1788658349.890528:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5597:x1875544076452864:12345-192.168.202.3@tcp:502: Request processed in 320us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658349.890537:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:2.0:1788658349.902448:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658349.902867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076452992 00000100:00100000:3.0:1788658349.902880:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076452992 00000100:00100000:3.0:1788658349.902944:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:3.0:1788658349.902955:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5578:x1875544076452992:12345-192.168.202.3@tcp:101: 00010000:00010000:3.0:1788658349.902975:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658349.902997:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57021d9800/0xf657f176650eaa67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ac67 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658349.903028:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d9800/0xf657f176650eaa67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac67 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658349.903371:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57021d9800/0xf657f176650eaa67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac67 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658349.903382:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9800, rc 0) 00000100:00100000:3.0:1788658349.903453:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5578:x1875544076452992:12345-192.168.202.3@tcp:101: Request processed in 500us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658349.903461:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:1.0:1788658349.909609:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658349.909726:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076453120 00000100:00100000:0.0:1788658349.909747:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076453120 00000100:00100000:0.0:1788658349.909815:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:0.0:1788658349.909827:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5578:x1875544076453120:12345-192.168.202.3@tcp:256: 20000000:01000000:0.0:1788658349.909857:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788658349.909886:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788658349.909890:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788658349.909893:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788658349.909896:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788658349.913746:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5578:x1875544076453120:12345-192.168.202.3@tcp:256: Request processed in 3899us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658349.913763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:1.0:1788658349.922785:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658349.922985:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076453248 00000100:00100000:2.0:1788658349.922997:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076453248 00000100:00100000:2.0:1788658349.923059:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:2.0:1788658349.923068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5578:x1875544076453248:12345-192.168.202.3@tcp:101: 00010000:00010000:2.0:1788658349.923086:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658349.923103:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ac6e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658349.923134:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658349.923157:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658349.923167:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc000, rc 0) 00000100:00100000:2.0:1788658349.923228:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5578:x1875544076453248:12345-192.168.202.3@tcp:101: Request processed in 160us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658349.923235:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:1.0:1788658349.927334:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658349.927434:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076453376 00000100:00100000:0.0:1788658349.927447:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076453376 00000100:00100000:0.0:1788658349.927529:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:0.0:1788658349.927539:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5578:x1875544076453376:12345-192.168.202.3@tcp:501: 00000100:00100000:0.0:1788658349.928136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5578:x1875544076453376:12345-192.168.202.3@tcp:501: Request processed in 596us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658349.928154:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:0.0:1788658349.931455:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658349.931747:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076453504 00000100:00100000:3.0:1788658349.931759:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076453504 00000100:00100000:3.0:1788658349.931935:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:3.0:1788658349.931948:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5578:x1875544076453504:12345-192.168.202.3@tcp:503: 00000100:00100000:3.0:1788658349.932394:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5578:x1875544076453504:12345-192.168.202.3@tcp:503: Request processed in 448us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658349.932402:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:1.0:1788658349.937274:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658349.937381:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076453632 00000100:00100000:0.0:1788658349.937394:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076453632 00000100:00100000:0.0:1788658349.937494:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:0.0:1788658349.937520:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5599:x1875544076453632:12345-192.168.202.3@tcp:502: 00000100:00100000:0.0:1788658349.937894:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5599:x1875544076453632:12345-192.168.202.3@tcp:502: Request processed in 388us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658349.937903:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:3.0:1788658349.941114:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658349.942162:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076453760 00000100:00100000:2.0:1788658349.942194:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076453760 00000100:00100000:2.0:1788658349.942253:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00100000:2.0:1788658349.942265:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5599:x1875544076453760:12345-192.168.202.3@tcp:502: 00000100:00100000:2.0:1788658349.942571:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5599:x1875544076453760:12345-192.168.202.3@tcp:502: Request processed in 307us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658349.942580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00100000:2.0:1788658349.947011:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658349.947225:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076453888 00000100:00100000:3.0:1788658349.947237:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076453888 00000100:00100000:3.0:1788658349.947288:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658349.947297:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1875544076453888:12345-192.168.202.3@tcp:38: 00010000:00080000:3.0:1788658349.947329:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1788658349.947380:0:6710:0:(genops.c:1385:class_connect()) connect: client df8d83e3-27bc-4e5d-ab80-c17af5c0fb38, cookie 0xf657f176650eaa75 00000004:00100000:3.0:1788658349.947414:0:6710:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788658349.947434:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788658349.979128:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9e570051a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658349.979351:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2350:x1875544076453888:12345-192.168.202.3@tcp:38: Request processed in 32052us (32349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658349.979364:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00010000:00010000:2.0:1788658350.813602:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658350.989761:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658350.989845:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658350.989960:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454016 00000100:00100000:1.0:1788658350.989973:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454016 00000100:00100000:1.0:1788658350.990048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454144 00000100:00100000:1.0:1788658350.990052:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454144 00000100:00100000:1.0:1788658350.990077:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658350.990089:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:0:x1875544076454016:12345-192.168.202.3@tcp:41: 00000004:00000024:1.0:1788658350.990146:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788658350.990238:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:0:x1875544076454016:12345-192.168.202.3@tcp:41: Request processed in 151us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658350.990247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658350.990265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1788658350.990271:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5578:x1875544076454144:12345-192.168.202.3@tcp:41: 00000004:00000024:1.0:1788658350.990282:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788658350.990304:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5578:x1875544076454144:12345-192.168.202.3@tcp:41: Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658350.990310:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00080000:3.0:1788658350.990820:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658350.999911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658351.004048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454272 00000100:00100000:1.0:1788658351.004069:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454272 00000100:00100000:1.0:1788658351.004173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:1.0:1788658351.004220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5578:x1875544076454272:12345-192.168.202.3@tcp:40: 00000100:00100000:1.0:1788658351.004352:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5578:x1875544076454272:12345-192.168.202.3@tcp:40: Request processed in 147us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658351.004359:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1788658351.006984:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658351.007018:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103738368:0@lo:13: 00000100:00100000:2.0:1788658351.007104:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658351.007358:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103738368 00000100:00100000:1.0:1788658351.007368:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103738368 00000100:00100000:1.0:1788658351.007450:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658351.007461:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103738368:12345-0@lo:13: 00002000:00000024:1.0:1788658351.007508:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658351.007575:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103738368:12345-0@lo:13: Request processed in 116us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658351.007581:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788658351.007693:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005a8000 x1875544103738368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658351.007713:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103738368:0@lo:13: 00000100:00080000:3.0:1788658351.009359:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658351.024335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658351.024385:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658351.024413:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658351.024458:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658351.024495:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454784 00000100:00100000:2.0:1788658351.024508:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454784 00000100:00100000:2.0:1788658351.024567:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:2.0:1788658351.024579:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076454784:12345-192.168.202.3@tcp:400: 00000100:00100000:2.0:1788658351.024698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076454784:12345-192.168.202.3@tcp:400: Request processed in 120us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658351.024706:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:1.0:1788658351.024967:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454656 00000100:00100000:1.0:1788658351.024973:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454656 00000100:00100000:1.0:1788658351.025029:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1788658351.025037:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5578:x1875544076454656:12345-192.168.202.3@tcp:33: 00000100:00100000:0.0:1788658351.025238:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454400 00000100:00100000:0.0:1788658351.025263:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454400 00000100:00100000:0.0:1788658351.025296:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454528 00000100:00100000:0.0:1788658351.025299:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454528 00000100:00100000:0.0:1788658351.025309:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658351.025314:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875544076454400:12345-192.168.202.3@tcp:8: 00010000:00080000:0.0:1788658351.025343:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1788658351.025379:0:6685:0:(genops.c:1385:class_connect()) connect: client df8d83e3-27bc-4e5d-ab80-c17af5c0fb38, cookie 0xf657f176650eaa7c 00002000:00100000:0.0:1788658351.025393:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df8d83e3-27bc-4e5d-ab80-c17af5c0fb38/ffff9e56fef68000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658351.025407:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658351.025904:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658351.025943:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9e56fef6d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658351.026007:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2350:x1875544076454400:12345-192.168.202.3@tcp:8: Request processed in 691us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658351.026016:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658351.026044:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1788658351.026049:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875544076454528:12345-192.168.202.3@tcp:8: 00010000:00080000:0.0:1788658351.026067:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1788658351.026090:0:6685:0:(genops.c:1385:class_connect()) connect: client df8d83e3-27bc-4e5d-ab80-c17af5c0fb38, cookie 0xf657f176650eaa83 00002000:00100000:0.0:1788658351.026098:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df8d83e3-27bc-4e5d-ab80-c17af5c0fb38/ffff9e56fef6e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658351.026120:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658351.026348:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658351.026365:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9e56fef69800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658351.026393:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2350:x1875544076454528:12345-192.168.202.3@tcp:8: Request processed in 342us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658351.026400:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000004:00080000:1.0:1788658351.064915:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39798us 00000004:00200000:0.0:1788658351.096913:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788658351.097076:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5578:x1875544076454656:12345-192.168.202.3@tcp:33: Request processed in 72033us (72752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658351.097094:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1788658351.423809:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658351.423885:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076454912 00000100:00100000:1.0:1788658351.423898:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076454912 00000100:00100000:1.0:1788658351.423975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658351.423988:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5616:x1875544076454912:12345-192.168.202.3@tcp:101: 00010000:00010000:1.0:1788658351.424015:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658351.425534:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678e00/0xf657f176650eaa8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ac98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658351.425648:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eaa91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658351.425700:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eaa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658351.425719:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eaa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658351.425963:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658351.425969:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658351.425992:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eaa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658351.426029:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678e00/0xf657f176650eaa8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac98 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658351.426054:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eaa91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac98 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658351.426064:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59700) 00010000:00010000:1.0:1788658351.426067:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658351.426071:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678600, rc 0) 00000100:00100000:1.0:1788658351.426248:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:5616:x1875544076454912:12345-192.168.202.3@tcp:101: Request processed in 2260us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658351.426257:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658351.517892:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658351.518987:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103738752:0@lo:400: 00000100:00100000:1.0:1788658351.519072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658351.519148:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658351.519155:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103738624:0@lo:400: 00000100:00100000:1.0:1788658351.519181:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658351.519234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103738752 00000100:00100000:1.0:1788658351.519243:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103738752 00000100:00100000:1.0:1788658351.519312:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103738624 00000100:00100000:1.0:1788658351.519315:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103738624 00000100:00100000:1.0:1788658351.519338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658351.519347:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103738752:12345-0@lo:400: 00000100:00100000:1.0:1788658351.519400:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103738752:12345-0@lo:400: Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658351.519408:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658351.521647:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658351.521686:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103738624:12345-0@lo:400: 00000100:00100000:1.0:1788658351.521801:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103738624:12345-0@lo:400: Request processed in 141us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658351.521810:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788658351.521969:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658351.522374:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103738624:0@lo:400: 00000100:00100000:1.0:1788658351.522395:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103738752:0@lo:400: 00000100:00100000:0.0:1788658351.529691:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103738880:0@lo:400: 00000100:00100000:0.0:1788658351.529802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658351.529853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103738496:0@lo:400: 00000100:00100000:0.0:1788658351.529886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658351.530058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103738496 00000100:00100000:1.0:1788658351.530078:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103738496 00000100:00100000:3.0:1788658351.530089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103738880 00000100:00100000:3.0:1788658351.530092:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103738880 00000100:00100000:3.0:1788658351.530131:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658351.530131:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788658351.530140:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103738880:12345-0@lo:400: 00000100:00100000:1.0:1788658351.530140:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103738496:12345-0@lo:400: 00000100:00100000:1.0:1788658351.530193:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103738496:12345-0@lo:400: Request processed in 55us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658351.530201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1788658351.530248:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658351.530342:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103739008:0@lo:400: 00000100:00100000:2.0:1788658351.530376:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658351.530905:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739008 00000100:00100000:1.0:1788658351.530911:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739008 00000100:00100000:1.0:1788658351.530970:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658351.530992:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103739008:12345-0@lo:400: 00000100:00100000:1.0:1788658351.531038:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103739008:12345-0@lo:400: Request processed in 48us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658351.531045:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658351.531065:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103738880:12345-0@lo:400: Request processed in 926us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658351.531072:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788658351.531083:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bf800 x1875544103739008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658351.531095:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788658351.531113:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103739008:0@lo:400: 00000100:00100000:0.0:1788658351.531411:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103738880:0@lo:400: 00000100:00100000:0.0:1788658351.531525:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103738496:0@lo:400: 00000100:00080000:2.0:1788658351.531713:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788658351.836843:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658352.034442:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103739136:0@lo:13: 00000100:00100000:2.0:1788658352.034525:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658352.034625:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739136 00000100:00100000:2.0:1788658352.034635:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739136 00000100:00100000:2.0:1788658352.034705:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658352.034717:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103739136:12345-0@lo:13: 00002000:00000024:2.0:1788658352.034743:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658352.034793:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103739136:12345-0@lo:13: Request processed in 78us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658352.034813:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788658352.034859:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b08700 x1875544103739136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658352.034880:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103739136:0@lo:13: 00000001:00100000:2.0:1788658352.102070:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00010000:00010000:2.0:1788658352.862448:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658353.638366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658353.638493:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455040 00000100:00100000:0.0:1788658353.638506:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455040 00000100:00100000:0.0:1788658353.638595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1788658353.638608:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:5668:x1875544076455040:12345-192.168.202.3@tcp:41: 00000004:00000024:0.0:1788658353.638711:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788658353.638805:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:5668:x1875544076455040:12345-192.168.202.3@tcp:41: Request processed in 200us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.638813:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00080000:2.0:1788658353.639107:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658353.646737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658353.647118:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455168 00000100:00100000:1.0:1788658353.647131:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455168 00000100:00100000:1.0:1788658353.647249:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:1.0:1788658353.647261:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:5668:x1875544076455168:12345-192.168.202.3@tcp:13: 00002000:00000024:1.0:1788658353.647303:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658353.647392:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:5668:x1875544076455168:12345-192.168.202.3@tcp:13: Request processed in 133us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658353.647401:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00080000:2.0:1788658353.647581:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658353.649632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658353.649719:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455296 00000100:00100000:1.0:1788658353.649730:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455296 00000100:00100000:1.0:1788658353.649872:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:1.0:1788658353.649884:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5668:x1875544076455296:12345-192.168.202.3@tcp:13: 00002000:00000024:1.0:1788658353.649931:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658353.650003:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:5668:x1875544076455296:12345-192.168.202.3@tcp:13: Request processed in 121us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658353.650011:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00080000:2.0:1788658353.650081:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788658353.884811:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658354.910234:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788658355.166702:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000001:00100000:3.0:1788658355.172542:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00010000:00010000:0.0:1788658355.938776:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658355.973394:0:8298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788658356.126812:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103739264:0@lo:13: 00000100:00100000:0.0:1788658356.127687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658356.127778:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739264 00000100:00100000:0.0:1788658356.127788:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739264 00000100:00100000:0.0:1788658356.127852:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658356.127871:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103739264:12345-0@lo:13: 00002000:00000024:0.0:1788658356.129054:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658356.130105:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103739264:12345-0@lo:13: Request processed in 2232us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658356.130130:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788658356.130172:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658356.133373:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b0a680 x1875544103739264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658356.133396:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103739264:0@lo:13: 00000100:00100000:3.0:1788658356.393785:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658356.393820:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658356.393858:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658356.393890:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658356.394085:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455680 00000100:00100000:1.0:1788658356.394110:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455680 00000100:00100000:1.0:1788658356.394177:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455808 00000100:00100000:1.0:1788658356.394181:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455808 00000100:00100000:1.0:1788658356.394202:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:1.0:1788658356.394213:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076455680:12345-192.168.202.3@tcp:400: 00000100:00100000:1.0:1788658356.394317:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076455680:12345-192.168.202.3@tcp:400: Request processed in 105us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658356.394325:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:1.0:1788658356.394344:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658356.394351:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076455808:12345-192.168.202.3@tcp:400: 00000100:00100000:1.0:1788658356.394375:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076455808:12345-192.168.202.3@tcp:400: Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658356.394380:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00080000:1.0:1788658356.394399:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658356.394403:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658356.394451:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455552 00000100:00100000:2.0:1788658356.394456:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455552 00000100:00100000:2.0:1788658356.394494:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:2.0:1788658356.394501:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076455552:12345-192.168.202.3@tcp:400: 00000100:00100000:2.0:1788658356.394536:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076455552:12345-192.168.202.3@tcp:400: Request processed in 35us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658356.394542:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1788658356.394622:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455424 00000100:00100000:0.0:1788658356.394627:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455424 00000100:00100000:0.0:1788658356.394655:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:0.0:1788658356.394679:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2352:x1875544076455424:12345-192.168.202.3@tcp:400: 00000100:00080000:3.0:1788658356.395018:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658356.408112:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2352:x1875544076455424:12345-192.168.202.3@tcp:400: Request processed in 13436us (14325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658356.408129:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:2.0:1788658356.637134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103739648:0@lo:400: 00000100:00100000:2.0:1788658356.637212:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658356.637298:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658356.637304:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103739776:0@lo:400: 00000100:00100000:2.0:1788658356.637328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658356.637506:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103739392:0@lo:400: 00000100:00100000:0.0:1788658356.637546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658356.637582:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103739904:0@lo:400: 00000100:00100000:0.0:1788658356.637607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658356.637625:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658356.637631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103739520:0@lo:400: 00000100:00100000:0.0:1788658356.637652:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658356.637692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739648 00000100:00100000:3.0:1788658356.637704:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739648 00000100:00100000:0.0:1788658356.637707:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739776 00000100:00100000:0.0:1788658356.637713:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739776 00000100:00100000:0.0:1788658356.637769:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739520 00000100:00100000:0.0:1788658356.637773:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739520 00000100:00100000:0.0:1788658356.637791:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658356.637847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739392 00000100:00100000:2.0:1788658356.637851:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739392 00000100:00100000:2.0:1788658356.637879:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788658356.637886:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103739392:12345-0@lo:400: 00000100:00100000:2.0:1788658356.637951:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103739392:12345-0@lo:400: Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658356.638069:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103739776:12345-0@lo:400: 00000100:00100000:0.0:1788658356.638108:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103739776:12345-0@lo:400: Request processed in 309us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658356.638140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788658356.641095:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658356.641121:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103739520:12345-0@lo:400: 00000100:00100000:1.0:1788658356.641294:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103739520:12345-0@lo:400: Request processed in 184us (3640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658356.641304:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658356.641355:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103739904 00000100:00100000:1.0:1788658356.641363:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103739904 00000100:00100000:1.0:1788658356.641419:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658356.641426:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103739904:12345-0@lo:400: 00000100:00100000:1.0:1788658356.641461:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103739904:12345-0@lo:400: Request processed in 36us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658356.641467:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658356.641564:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103739520:0@lo:400: 00000100:00100000:1.0:1788658356.641578:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103739392:0@lo:400: 00010000:00080000:1.0:1788658356.642273:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56ff01c700 x1875544103739904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658356.642288:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103739904:0@lo:400: 00000100:00100000:1.0:1788658356.642359:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103739776:0@lo:400: 00000100:00100000:0.0:1788658356.647033:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788658356.647179:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658356.647187:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658356.647973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658356.647996:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103739648:12345-0@lo:400: 00000100:00100000:3.0:1788658356.648123:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103739648:12345-0@lo:400: Request processed in 141us (10910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658356.648145:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658356.648350:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103739648:0@lo:400: 00010000:00010000:1.0:1788658356.957478:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658357.150769:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103740032:0@lo:13: 00000100:00100000:1.0:1788658357.150857:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658357.151416:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103740032 00000100:00100000:0.0:1788658357.151429:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103740032 00000100:00100000:0.0:1788658357.151498:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658357.151510:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103740032:12345-0@lo:13: 00002000:00000024:0.0:1788658357.151550:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658357.151620:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103740032:12345-0@lo:13: Request processed in 113us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658357.151627:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788658357.151762:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005ab800 x1875544103740032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658357.151786:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103740032:0@lo:13: 00010000:00010000:0.0:1788658357.980959:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658359.005759:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658359.297628:0:8445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf48c87a0 20000000:00000080:0.0:1788658359.297645:0:8445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5700b80800 uarg=0000000000000000 20000000:01000000:0.0:1788658359.297705:0:8445:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788658359.297708:0:8445:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788658359.297711:0:8445:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788658359.297716:0:8445:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788658359.297722:0:8445:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788658359.297752:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788658359.297755:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788658359.298377:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788658359.298381:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788658359.300769:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788658359.313433:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788658359.313500:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788658359.313521:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788658359.313533:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788658359.313536:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788658359.314545:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788658359.315196:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788658359.315243:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788658359.315292:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788658359.315306:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788658359.315308:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788658359.316605:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788658359.317634:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788658359.317755:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788658359.318067:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788658359.318087:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788658359.318090:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788658359.319237:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788658359.319728:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788658359.320297:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788658359.320348:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1788658359.320370:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788658359.320402:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320420:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea98e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320427:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320445:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320451:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320457:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9fe expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320462:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaa1a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320468:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaa44 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320476:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320482:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320488:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320532:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320545:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 9 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.320569:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740160:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658359.320703:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.320712:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 9 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.320722:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740288:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658359.321625:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eaa44 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.321637:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eaa44 expref: 18 pid: 5830 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.321646:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740416:0@lo:104: 00000100:00100000:2.0:1788658359.322929:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658359.323956:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eaa1a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.323971:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eaa1a expref: 18 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.323986:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740544:0@lo:104: 00000100:00100000:1.0:1788658359.324003:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103740416 00000100:00100000:1.0:1788658359.324012:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103740416 00000100:00100000:2.0:1788658359.324040:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658359.324104:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea9fe expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.324113:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea9fe expref: 18 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.324122:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740672:0@lo:104: 00000100:00100000:1.0:1788658359.324142:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788658359.324146:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.324153:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 18 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.324159:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658359.324161:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740800:0@lo:104: 00000100:00100000:1.0:1788658359.324168:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103740544 00000100:00100000:1.0:1788658359.324171:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103740544 00000100:00100000:1.0:1788658359.324185:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103740672 00000100:00100000:1.0:1788658359.324188:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103740672 00000100:00100000:2.0:1788658359.324191:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658359.324197:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103740800 00000100:00100000:1.0:1788658359.324200:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103740800 00010000:00010000:2.0:1788658359.324208:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.324213:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788658359.324216:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 18 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.324222:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+6:8445:x1875544103740416:12345-0@lo:104: 00000100:00100000:2.0:1788658359.324223:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740928:0@lo:104: 00010000:00010000:1.0:1788658359.324234:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.324251:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658359.324267:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.324274:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 18 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.324283:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103741056:0@lo:104: 00000100:00100000:2.0:1788658359.324298:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658359.324305:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658359.324312:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+6:8445:x1875544103740416:12345-0@lo:104: Request processed in 90us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658359.324319:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658359.324346:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103740928 00000100:00100000:1.0:1788658359.324350:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103740928 00000100:00100000:1.0:1788658359.324361:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741056 00000100:00100000:1.0:1788658359.324363:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741056 00000100:00100000:1.0:1788658359.324402:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658359.324408:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56feff0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+7:8445:x1875544103740544:12345-0@lo:104: 00010000:00010000:1.0:1788658359.324416:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.324445:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea98e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.324451:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788658359.324453:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea98e expref: 18 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.324456:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56feff0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+7:8445:x1875544103740544:12345-0@lo:104: Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658359.324462:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103741184:0@lo:104: 00000100:00100000:1.0:1788658359.324462:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658359.324482:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658359.324491:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658359.324493:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741184 00000100:00100000:1.0:1788658359.324496:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741184 00000100:00100000:1.0:1788658359.324507:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658359.324512:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+7:8445:x1875544103740672:12345-0@lo:104: 00000100:00100000:2.0:1788658359.324514:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740416:0@lo:104: 00010000:00010000:1.0:1788658359.324519:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.324523:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740544:0@lo:104: 00010000:00010000:1.0:1788658359.324551:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788658359.324556:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+7:8445:x1875544103740672:12345-0@lo:104: Request processed in 44us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658359.324570:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658359.324578:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740672:0@lo:104: 00000100:00100000:1.0:1788658359.324582:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658359.324588:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+6:8445:x1875544103740800:12345-0@lo:104: 00010000:00010000:1.0:1788658359.324595:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.324632:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788658359.324637:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+6:8445:x1875544103740800:12345-0@lo:104: Request processed in 50us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658359.324642:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658359.324654:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658359.324659:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+5:8445:x1875544103740928:12345-0@lo:104: 00010000:00010000:1.0:1788658359.324686:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.324697:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740800:0@lo:104: 00010000:00010000:0.0:1788658359.325046:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788658359.325053:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325069:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658359.325073:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325080:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658359.325084:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658359.325088:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658359.325119:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325124:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788658359.325152:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103741312:0@lo:103: 00010000:00010000:0.0:1788658359.325152:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325159:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1679200/0xf657f176650eaa44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325170:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788658359.325173:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325178:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0030400 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658359.325181:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325198:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658359.325203:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658359.325208:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658359.325228:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325234:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658359.325240:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325246:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0030400/0xf657f176650eaa1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.325259:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103741440:0@lo:103: 00010000:00010000:0.0:1788658359.325266:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658359.325269:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325274:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679600 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658359.325277:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325284:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658359.325290:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658359.325301:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658359.325314:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325319:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658359.325342:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325349:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1679600/0xf657f176650ea9fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaa05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325359:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658359.325362:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325367:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8a00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658359.325370:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.325371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658359.325378:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658359.325385:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658359.325390:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658359.325402:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325407:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658359.325418:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325425:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57021d8a00/0xf657f176650ea9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658359.325435:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658359.325437:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658359.325439:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658359.325446:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103741568:0@lo:103: 00000100:00100000:3.0:1788658359.325470:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658359.325497:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103741696:0@lo:103: 00000100:00100000:3.0:1788658359.325543:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658359.325611:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741312 00000100:00100000:2.0:1788658359.325616:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741312 00010000:00010000:2.0:1788658359.325638:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eaa44 expref: 19 pid: 5830 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.325761:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741568 00000100:00100000:2.0:1788658359.325766:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741568 00010000:00010000:2.0:1788658359.325779:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9fe expref: 20 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.325870:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741440 00000100:00100000:3.0:1788658359.325874:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741440 00010000:00010000:3.0:1788658359.325889:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eaa1a expref: 21 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.325905:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658359.325912:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+21:3304:x1875544103741312:12345-0@lo:103: 00010000:00010000:3.0:1788658359.325923:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658359.325928:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eaa44 expref: 21 pid: 5830 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.325947:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eaa44 expref: 21 pid: 5830 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.325969:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d9c00/0xf657f176650eaa4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eaa44 expref: 21 pid: 5830 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.325983:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658359.326016:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+20:3304:x1875544103741312:12345-0@lo:103: Request processed in 104us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658359.326035:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658359.326051:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658359.326057:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103741568:12345-0@lo:103: 00010000:00010000:3.0:1788658359.326065:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658359.326069:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9fe expref: 19 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.326077:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea9fe expref: 19 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.326077:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658359.326083:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+5:8445:x1875544103740928:12345-0@lo:104: Request processed in 1424us (1831us total) trans 0 rc 0/0 00010000:00010000:3.0:1788658359.326086:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c0031e00/0xf657f176650eaa05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea9fe expref: 19 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.326090:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788658359.326095:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658359.326105:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658359.326111:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:8445:x1875544103741056:12345-0@lo:104: 00000100:00100000:3.0:1788658359.326117:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+18:3306:x1875544103741568:12345-0@lo:103: Request processed in 62us (648us total) trans 0 rc 0/0 00010000:00010000:1.0:1788658359.326119:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.326123:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658359.326133:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658359.326139:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+17:3305:x1875544103741440:12345-0@lo:103: 00010000:00010000:3.0:1788658359.326146:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658359.326146:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788658359.326151:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eaa1a expref: 17 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.326151:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:8445:x1875544103741056:12345-0@lo:104: Request processed in 41us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658359.326162:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788658359.326164:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eaa1a expref: 17 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.326173:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c0031000/0xf657f176650eaa21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eaa1a expref: 17 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.326173:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658359.326178:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:8445:x1875544103741184:12345-0@lo:104: 00010000:00010000:1.0:1788658359.326185:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.326194:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658359.326210:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788658359.326214:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+16:3305:x1875544103741440:12345-0@lo:103: Request processed in 76us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658359.326215:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:8445:x1875544103741184:12345-0@lo:104: Request processed in 38us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658359.326220:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658359.326220:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788658359.326235:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788658359.326239:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.326245:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103741568:0@lo:103: 00010000:00010000:1.0:1788658359.326246:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0030200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:1.0:1788658359.326249:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.326255:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.326272:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103741440:0@lo:103: 00000100:00100000:3.0:1788658359.326293:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103741312:0@lo:103: 00000100:00100000:2.0:1788658359.326571:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740928:0@lo:104: 00000100:00100000:2.0:1788658359.326580:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103741056:0@lo:104: 00000100:00100000:2.0:1788658359.326586:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103741184:0@lo:104: 00000100:00100000:0.0:1788658359.326905:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658359.326925:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788658359.327019:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741696 00000100:00100000:3.0:1788658359.327038:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741696 00010000:00010000:3.0:1788658359.327061:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 16 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.327082:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658359.327089:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+16:3307:x1875544103741696:12345-0@lo:103: 00010000:00010000:3.0:1788658359.327097:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658359.327101:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 16 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327110:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 16 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327134:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ea9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea9f0 expref: 16 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327144:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658359.327174:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+15:3307:x1875544103741696:12345-0@lo:103: Request processed in 87us (271us total) trans 0 rc 0/0 10000000:00010000:1.0:1788658359.327177:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658359.327183:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788658359.327225:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103741696:0@lo:103: 00000100:00100000:3.0:1788658359.327465:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1788658359.327493:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327500:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788658359.327540:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103741824:0@lo:103: 00010000:00010000:1.0:1788658359.327550:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327556:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0030200/0xf657f176650ea9e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327568:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658359.327571:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.327573:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658359.327578:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8400 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:1.0:1788658359.327582:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327589:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658359.327596:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.327597:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741824 00000100:00100000:3.0:1788658359.327600:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741824 10000000:01000000:1.0:1788658359.327601:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658359.327614:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 15 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327617:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327623:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658359.327630:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.327631:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658359.327637:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+15:3304:x1875544103741824:12345-0@lo:103: 00010000:00010000:1.0:1788658359.327637:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57021d8400/0xf657f176650ea98e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea995 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327644:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658359.327648:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 15 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327648:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658359.327655:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 15 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.327686:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658359.327687:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658359.327707:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103741952:0@lo:103: 00010000:00010000:3.0:1788658359.327711:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cd400/0xf657f176650ea9e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea9e2 expref: 15 pid: 5832 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327719:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658359.327731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658359.327736:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+14:3304:x1875544103741824:12345-0@lo:103: Request processed in 100us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658359.327747:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658359.327758:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103741952 00000100:00100000:3.0:1788658359.327761:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103741952 00010000:00010000:3.0:1788658359.327772:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea98e expref: 14 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.327773:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103741824:0@lo:103: 00000100:00100000:3.0:1788658359.327798:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658359.327804:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+14:3305:x1875544103741952:12345-0@lo:103: 00010000:00010000:3.0:1788658359.327811:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658359.327815:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea98e expref: 14 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327823:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea98e expref: 14 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327834:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cc800/0xf657f176650ea995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea98e expref: 14 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.327841:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658359.327875:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+13:3305:x1875544103741952:12345-0@lo:103: Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658359.327881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658359.327963:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103741952:0@lo:103: 00010000:00010000:0.0:1788658359.328490:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658359.328493:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658359.328495:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658359.328514:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.328523:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658359.328527:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.328535:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658359.328542:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658359.328546:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658359.328589:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.328594:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658359.328611:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658359.328626:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788658359.328627:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650ea9b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9bf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658359.328637:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103742080:0@lo:103: 00010000:00010000:2.0:1788658359.328641:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658359.328642:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658359.328644:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658359.328696:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658359.328868:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742080 00000100:00100000:1.0:1788658359.328872:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742080 00010000:00010000:1.0:1788658359.328887:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 13 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658359.328909:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658359.328916:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8936450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+13:3307:x1875544103742080:12345-0@lo:103: 00010000:00010000:1.0:1788658359.329064:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658359.329069:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 13 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.329079:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 13 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.329092:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d9200/0xf657f176650ea9bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea9b8 expref: 13 pid: 5831 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658359.329102:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658359.329135:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8936450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+12:3307:x1875544103742080:12345-0@lo:103: Request processed in 219us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658359.329142:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658359.329155:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103742080:0@lo:103: 00000100:00100000:3.0:1788658359.335467:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658359.335540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658359.335573:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076455936 00000100:00100000:3.0:1788658359.335583:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076455936 00010000:00010000:3.0:1788658359.335624:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 10 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.335656:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456064 00000100:00100000:3.0:1788658359.335702:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456064 00010000:00010000:3.0:1788658359.335717:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 11 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658359.335755:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1788658359.335766:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:2354:x1875544076455936:12345-192.168.202.3@tcp:103: 00010000:00010000:3.0:1788658359.335783:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658359.335804:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 11 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.335820:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 11 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658359.335841:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658359.335896:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:2354:x1875544076455936:12345-192.168.202.3@tcp:103: Request processed in 131us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658359.335904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00010000:00010000:2.0:1788658359.336070:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c0030000/0xf657f176650eaa60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac3d expref: 10 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.336084:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740160:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658359.336095:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875544103740288:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658359.336143:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658359.336430:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1788658359.336440:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:2354:x1875544076456064:12345-192.168.202.3@tcp:103: 00010000:00010000:2.0:1788658359.336449:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658359.336454:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 9 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336464:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 9 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336473:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cc200/0xf657f176650eaa59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac36 expref: 9 pid: 5831 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336485:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336501:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336517:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336523:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336529:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336535:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336541:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658359.336545:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336553:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336566:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336575:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658359.336600:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:2354:x1875544076456064:12345-192.168.202.3@tcp:103: Request processed in 162us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658359.336607:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00010000:00010000:2.0:1788658359.336637:0:8445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336650:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658359.336656:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678800/0xf657f176650eaa98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658360.031306:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658361.052891:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658361.052960:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788658361.052965:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56fef6c800 from 39 10000000:01000000:2.0:1788658361.052971:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658361.053022:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.053034:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.053048:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658361.053086:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742208:0@lo:101: 00000100:00100000:2.0:1788658361.053171:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.053339:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658361.055170:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742208 00000100:00100000:0.0:1788658361.055186:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742208 00000100:00100000:0.0:1788658361.055374:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788658361.055385:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+12:5834:x1875544103742208:12345-0@lo:101: 00010000:00010000:0.0:1788658361.055405:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658361.055429:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79400/0xf657f176650eaaa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaa9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.055481:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79400/0xf657f176650eaaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaa9f expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.055493:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79400/0xf657f176650eaaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaa9f expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.055503:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79400, rc 0) 00000100:00100000:0.0:1788658361.055602:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103742208:12345-0@lo:101: Request processed in 218us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.055609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788658361.055859:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742208:0@lo:101: 00010000:00010000:1.0:1788658361.055883:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.055894:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658361.055965:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742336:0@lo:501: 00000100:00100000:1.0:1788658361.056003:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.056044:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658361.056106:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742336 00000100:00100000:3.0:1788658361.056113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742336 00000100:00100000:3.0:1788658361.056146:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788658361.056154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103742336:12345-0@lo:501: 00000100:00100000:3.0:1788658361.056533:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103742336:12345-0@lo:501: Request processed in 379us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658361.056541:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788658361.056649:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742336:0@lo:501: 00000100:00100000:1.0:1788658361.056706:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742464:0@lo:503: 00000100:00100000:1.0:1788658361.056746:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.056816:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.060184:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742464 00000100:00100000:2.0:1788658361.060199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742464 00000100:00100000:2.0:1788658361.060369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788658361.060381:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103742464:12345-0@lo:503: 00000100:00100000:2.0:1788658361.060803:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103742464:12345-0@lo:503: Request processed in 423us (4054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.060811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788658361.064425:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742464:0@lo:503: 00000100:00100000:3.0:1788658361.065519:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8464:1875544103742592:0@lo:502: 00000100:00100000:3.0:1788658361.065610:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658361.065777:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658361.069705:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742592 00000100:00100000:0.0:1788658361.069722:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742592 00000100:00100000:0.0:1788658361.069796:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788658361.069807:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:8464:x1875544103742592:12345-0@lo:502: 00000100:00100000:0.0:1788658361.070160:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:8464:x1875544103742592:12345-0@lo:502: Request processed in 355us (4550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.070169:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788658361.070375:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8464:1875544103742592:0@lo:502: 00000100:00100000:3.0:1788658361.070456:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8464:1875544103742720:0@lo:502: 00000100:00100000:3.0:1788658361.070503:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658361.070599:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.072549:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742720 00000100:00100000:1.0:1788658361.072566:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742720 00000100:00100000:1.0:1788658361.072622:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788658361.072631:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:8464:x1875544103742720:12345-0@lo:502: 00000100:00100000:1.0:1788658361.072963:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+13:8464:x1875544103742720:12345-0@lo:502: Request processed in 331us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.072972:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788658361.073133:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8464:1875544103742720:0@lo:502: 00000040:00080000:3.0:1788658361.073179:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788658361.073445:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788658361.073464:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658361.073476:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.073500:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658361.073510:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788658361.073513:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788658361.073516:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788658361.073552:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.073560:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.073571:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658361.073593:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742848:0@lo:101: 00000100:00100000:1.0:1788658361.073635:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.073706:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658361.073776:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742848 00000100:00100000:0.0:1788658361.073782:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742848 00000100:00100000:0.0:1788658361.073812:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788658361.073820:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+13:5834:x1875544103742848:12345-0@lo:101: 00010000:00010000:0.0:1788658361.073831:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658361.073846:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac78600/0xf657f176650eaab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaaad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.073871:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac78600/0xf657f176650eaab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaaad expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.073895:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac78600/0xf657f176650eaab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaaad expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.073904:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78600, rc 0) 00000100:00100000:0.0:1788658361.074661:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103742848:12345-0@lo:101: Request processed in 838us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.074700:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788658361.075146:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742848:0@lo:101: 00010000:00010000:1.0:1788658361.075168:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.075180:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658361.075416:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742976:0@lo:501: 00000100:00100000:1.0:1788658361.075462:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.075553:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658361.075597:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103742976 00000100:00100000:0.0:1788658361.075604:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103742976 00000100:00100000:0.0:1788658361.075701:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788658361.075711:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103742976:12345-0@lo:501: 00000100:00100000:0.0:1788658361.075987:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103742976:12345-0@lo:501: Request processed in 277us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.075995:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788658361.076061:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103742976:0@lo:501: 00000100:00100000:1.0:1788658361.076103:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743104:0@lo:503: 00000100:00100000:1.0:1788658361.076142:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.076321:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658361.076350:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103743104 00000100:00100000:3.0:1788658361.076355:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103743104 00000100:00100000:3.0:1788658361.076380:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788658361.076386:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103743104:12345-0@lo:503: 00000100:00100000:3.0:1788658361.076573:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103743104:12345-0@lo:503: Request processed in 186us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658361.076580:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788658361.077104:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743104:0@lo:503: 00000100:00100000:3.0:1788658361.077490:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8465:1875544103743232:0@lo:502: 00000100:00100000:3.0:1788658361.077535:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658361.077598:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.077626:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103743232 00000100:00100000:1.0:1788658361.077630:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103743232 00000100:00100000:1.0:1788658361.077737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788658361.077746:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:8465:x1875544103743232:12345-0@lo:502: 00000100:00100000:1.0:1788658361.077910:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+14:8465:x1875544103743232:12345-0@lo:502: Request processed in 165us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.077917:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788658361.077973:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8465:1875544103743232:0@lo:502: 00000020:01000000:3.0:1788658361.077996:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658361.078005:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658361.078008:0:8465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788658361.078013:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788658361.078032:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8465:1875544103743360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658361.078066:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658361.078418:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.078495:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103743360 00000100:00100000:2.0:1788658361.078500:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103743360 00000100:00100000:2.0:1788658361.078524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788658361.078530:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:8465:x1875544103743360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658361.078659:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:8465:x1875544103743360:12345-0@lo:502:llog_process_th.0 Request processed in 128us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.078697:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788658361.078909:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8465:1875544103743360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658361.078930:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658361.078934:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658361.078936:0:8465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658361.078940:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788658361.079046:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788658361.079063:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788658361.079075:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.079096:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658361.079106:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788658361.079109:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e57014ee800 from 39 10000000:01000000:2.0:1788658361.079111:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658361.079140:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.079148:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.079157:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658361.079180:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.079227:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.079251:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.079263:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103743488 00000100:00100000:2.0:1788658361.079267:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103743488 00000100:00100000:2.0:1788658361.079286:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788658361.079292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+14:5834:x1875544103743488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658361.079300:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658361.079314:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cca00/0xf657f176650eaac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaabb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.079335:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cca00/0xf657f176650eaac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaabb expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.079347:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cca00/0xf657f176650eaac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaabb expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.079355:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cca00, rc 0) 00000100:00100000:2.0:1788658361.079384:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103743488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.079390:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788658361.079419:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658361.079432:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.079441:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658361.079492:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.079515:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.079527:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.079538:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103743616 00000100:00100000:2.0:1788658361.079541:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103743616 00000100:00100000:2.0:1788658361.079556:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788658361.079561:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103743616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.079817:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103743616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.079825:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788658361.079863:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.079887:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.079923:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.079935:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.079946:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103743744 00000100:00100000:2.0:1788658361.079949:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103743744 00000100:00100000:2.0:1788658361.079965:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788658361.079969:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103743744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.080111:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103743744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.080117:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788658361.080150:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103743744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.080293:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8466:1875544103743872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658361.080330:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.080349:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103743872 00000100:00100000:2.0:1788658361.080352:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103743872 00000100:00100000:2.0:1788658361.080369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788658361.080375:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8466:x1875544103743872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658361.080518:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8466:x1875544103743872:12345-0@lo:502:llog_process_th.0 Request processed in 142us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.080525:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788658361.080563:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.080576:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8466:1875544103743872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658361.080614:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8466:1875544103744000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658361.080648:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.080694:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744000 00000100:00100000:2.0:1788658361.080698:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744000 00000100:00100000:2.0:1788658361.080715:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788658361.080721:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8466:x1875544103744000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658361.080839:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:8466:x1875544103744000:12345-0@lo:502:llog_process_th.0 Request processed in 118us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.080845:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788658361.080870:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.080884:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8466:1875544103744000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788658361.080901:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788658361.080949:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788658361.080962:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658361.080971:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.080989:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658361.080998:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788658361.081000:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788658361.081003:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788658361.081025:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.081034:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.081043:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658361.081057:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.081096:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.081109:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.081121:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744128 00000100:00100000:2.0:1788658361.081125:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744128 00000100:00100000:2.0:1788658361.081143:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788658361.081149:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+15:5834:x1875544103744128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658361.081157:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658361.081171:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc400/0xf657f176650eaad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaac9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.081192:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc400/0xf657f176650eaad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaac9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.081214:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc400/0xf657f176650eaad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaac9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.081223:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc400, rc 0) 00000100:00100000:2.0:1788658361.081254:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103744128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.081260:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788658361.081287:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658361.081298:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658361.081307:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658361.081347:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.081370:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.081382:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.081393:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744256 00000100:00100000:2.0:1788658361.081396:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744256 00000100:00100000:2.0:1788658361.081411:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788658361.081416:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103744256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.081623:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103744256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.081630:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788658361.081659:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.081722:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.081759:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.081773:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c56760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.081784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744384 00000100:00100000:2.0:1788658361.081787:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744384 00000100:00100000:2.0:1788658361.081803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788658361.081809:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103744384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.081937:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103744384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.081944:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788658361.081980:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658361.083628:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8467:1875544103744512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658361.083842:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658361.083923:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.083959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744512 00000100:00100000:2.0:1788658361.083967:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744512 00000100:00100000:2.0:1788658361.084048:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788658361.084057:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:8467:x1875544103744512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658361.084315:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+16:8467:x1875544103744512:12345-0@lo:502:llog_process_th.0 Request processed in 258us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.084324:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788658361.084399:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8467:1875544103744512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658361.084439:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658361.084449:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658361.084451:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788658361.084457:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788658361.084482:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8467:1875544103744640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658361.084517:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658361.084807:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.084956:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744640 00000100:00100000:1.0:1788658361.084963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744640 00000100:00100000:1.0:1788658361.084993:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788658361.085001:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:8467:x1875544103744640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658361.085176:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:8467:x1875544103744640:12345-0@lo:502:llog_process_th.0 Request processed in 175us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.085183:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788658361.085261:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8467:1875544103744640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658361.085285:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658361.085290:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658361.085291:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788658361.085295:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788658361.085437:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788658361.085458:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788658361.085469:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.085480:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658361.085497:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788658361.085499:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56f44c2000 from 39 10000000:01000000:1.0:1788658361.085502:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658361.085528:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.085537:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.085546:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658361.085564:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658361.085597:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.085622:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5cc3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658361.085698:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744768 00000100:00100000:3.0:1788658361.085704:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744768 00000100:00100000:3.0:1788658361.085726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788658361.085733:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103744768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658361.085742:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658361.085758:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29df200/0xf657f176650eaade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaad7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658361.085782:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29df200/0xf657f176650eaade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaad7 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658361.085793:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29df200/0xf657f176650eaade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaad7 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658361.085802:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29df200, rc 0) 00000100:00100000:3.0:1788658361.085843:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103744768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658361.085849:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788658361.085916:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658361.085929:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.085939:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658361.085986:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658361.086009:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.086035:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5cc3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658361.086085:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103744896 00000100:00100000:3.0:1788658361.086089:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103744896 00000100:00100000:3.0:1788658361.086106:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788658361.086112:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103744896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658361.086594:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103744896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658361.086601:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788658361.086773:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103744896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658361.086808:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658361.086856:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.086914:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5cc3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.086966:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745024 00000100:00100000:2.0:1788658361.086972:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745024 00000100:00100000:3.0:1788658361.087018:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788658361.087027:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103745024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658361.087192:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103745024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658361.087199:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788658361.087441:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658361.087759:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8468:1875544103745152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658361.087801:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.087822:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5cc3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658361.087874:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745152 00000100:00100000:0.0:1788658361.087880:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745152 00000100:00100000:0.0:1788658361.087906:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788658361.087913:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8468:x1875544103745152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658361.088122:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8468:x1875544103745152:12345-0@lo:502:llog_process_th.0 Request processed in 208us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.088129:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788658361.088273:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8468:1875544103745152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658361.088317:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8468:1875544103745280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658361.088354:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658361.088375:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c56753c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658361.088414:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745280 00000100:00100000:0.0:1788658361.088419:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745280 00000100:00100000:0.0:1788658361.088438:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788658361.088443:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8468:x1875544103745280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658361.088581:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8468:x1875544103745280:12345-0@lo:502:llog_process_th.0 Request processed in 136us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.088595:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788658361.088839:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8468:1875544103745280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788658361.088860:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788658361.089010:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788658361.089029:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658361.089040:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.089049:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658361.089059:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788658361.089061:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788658361.089064:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788658361.089101:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.089110:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.089120:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658361.089136:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658361.089168:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.089283:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.089329:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745408 00000100:00100000:1.0:1788658361.089334:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745408 00000100:00100000:1.0:1788658361.089372:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788658361.089381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103745408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658361.089390:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658361.089404:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1678800/0xf657f176650eaaec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaae5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.089426:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678800/0xf657f176650eaaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaae5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.089437:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1678800/0xf657f176650eaaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaae5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658361.089458:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678800, rc 0) 00000100:00100000:1.0:1788658361.089585:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103745408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.089591:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788658361.089814:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658361.089830:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.089852:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658361.089913:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658361.089943:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.090004:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.090040:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745536 00000100:00100000:1.0:1788658361.090045:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745536 00000100:00100000:1.0:1788658361.090115:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788658361.090122:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103745536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658361.090461:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103745536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.090469:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788658361.090533:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658361.090565:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658361.090600:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.090883:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658361.090941:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745664 00000100:00100000:2.0:1788658361.090947:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745664 00000100:00100000:2.0:1788658361.090974:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788658361.090982:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103745664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658361.091159:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103745664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.091176:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788658361.091465:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103745664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658361.091652:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8469:1875544103745792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658361.091708:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.091878:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.091941:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745792 00000100:00100000:1.0:1788658361.091946:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745792 00000100:00100000:1.0:1788658361.091972:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788658361.091980:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8469:x1875544103745792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658361.092195:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8469:x1875544103745792:12345-0@lo:502:llog_process_th.0 Request processed in 215us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.092203:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788658361.092302:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8469:1875544103745792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658361.092326:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658361.092335:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658361.092338:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788658361.092344:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788658361.092364:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8469:1875544103745920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658361.092397:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.092418:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.092459:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103745920 00000100:00100000:1.0:1788658361.092464:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103745920 00000100:00100000:1.0:1788658361.092523:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788658361.092530:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8469:x1875544103745920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658361.092686:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:8469:x1875544103745920:12345-0@lo:502:llog_process_th.0 Request processed in 133us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.092694:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788658361.092808:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8469:1875544103745920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658361.092835:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658361.092840:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658361.092841:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788658361.092845:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788658361.092902:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788658361.092918:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788658361.092928:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.092938:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658361.092948:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788658361.092950:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e56c56c19c0 from 1 10000000:01000000:0.0:1788658361.092953:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788658361.092976:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.092985:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.092994:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658361.093008:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103746048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658361.093035:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.093201:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658361.093311:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746048 00000100:00100000:3.0:1788658361.093317:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746048 00000100:00100000:3.0:1788658361.093342:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788658361.093348:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103746048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658361.093357:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658361.093369:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dfe00/0xf657f176650eaafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaaf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658361.093391:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dfe00/0xf657f176650eaafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaaf3 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658361.093401:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dfe00/0xf657f176650eaafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaaf3 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658361.093416:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dfe00, rc 0) 00000100:00100000:3.0:1788658361.093484:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103746048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658361.093490:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788658361.093550:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103746048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658361.093563:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaafa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.093576:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaafa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658361.093616:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103746176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658361.093638:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.093658:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e317b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658361.093821:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746176 00000100:00100000:1.0:1788658361.093825:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746176 00000100:00100000:1.0:1788658361.093842:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788658361.093847:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103746176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658361.094045:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103746176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (405us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658361.094051:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788658361.094109:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103746176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788658361.094130:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788658361.094135:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaafa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658361.094142:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaafa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658361.245972:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658361.246002:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103746304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658361.246091:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658361.246229:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746304 00000100:00100000:0.0:1788658361.246239:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746304 00000100:00100000:0.0:1788658361.246308:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658361.246320:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103746304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658361.246360:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658361.246424:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103746304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.246431:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788658361.246556:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658361.246596:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b0a680 x1875544103746304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658361.246616:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103746304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658361.519393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658361.519444:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658361.519482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658361.519532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658361.519628:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456448 00000100:00100000:0.0:1788658361.519641:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456448 00000100:00100000:0.0:1788658361.519757:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456576 00000100:00100000:0.0:1788658361.519761:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456576 00000100:00100000:0.0:1788658361.519795:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658361.519807:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076456448:12345-192.168.202.3@tcp:400: 00000100:00100000:0.0:1788658361.519893:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076456448:12345-192.168.202.3@tcp:400: Request processed in 87us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.519901:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658361.519921:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658361.519927:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076456576:12345-192.168.202.3@tcp:400: 00000100:00100000:0.0:1788658361.519950:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076456576:12345-192.168.202.3@tcp:400: Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.519955:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658361.520179:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456192 00000100:00100000:1.0:1788658361.520185:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456192 00000100:00100000:1.0:1788658361.520229:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:1.0:1788658361.520237:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:2352:x1875544076456192:12345-192.168.202.3@tcp:400: 00000100:00100000:1.0:1788658361.520266:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:2352:x1875544076456192:12345-192.168.202.3@tcp:400: Request processed in 31us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658361.520273:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:2.0:1788658361.520364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456320 00000100:00100000:2.0:1788658361.520369:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456320 00000100:00100000:2.0:1788658361.520414:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1788658361.520423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076456320:12345-192.168.202.3@tcp:400: 00000100:00100000:2.0:1788658361.520456:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076456320:12345-192.168.202.3@tcp:400: Request processed in 35us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.520462:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00080000:3.0:1788658361.520659:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658361.520693:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658361.520695:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658361.756941:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658361.761296:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103746560:0@lo:400:kworker.0 00000100:00100000:2.0:1788658361.761395:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.761575:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103746432:0@lo:400:kworker.0 00000100:00100000:2.0:1788658361.761602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658361.762267:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103746688:0@lo:400:kworker.0 00000100:00100000:3.0:1788658361.762313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.762392:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103746816:0@lo:400:kworker.0 00000100:00100000:2.0:1788658361.762422:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658361.762477:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746816 00000100:00100000:2.0:1788658361.762487:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746816 00000100:00100000:2.0:1788658361.762554:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658361.762565:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103746816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658361.762636:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103746816:12345-0@lo:400:kworker.0 Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658361.762644:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788658361.762695:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658361.762725:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56ff01dc00 x1875544103746816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658361.762758:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103746816:0@lo:400:kworker.0 00000100:00100000:0.0:1788658361.764578:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746560 00000100:00100000:0.0:1788658361.764595:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746560 00000100:00100000:0.0:1788658361.764716:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746432 00000100:00100000:0.0:1788658361.764721:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746432 00000100:00100000:0.0:1788658361.764749:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658361.764760:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103746560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658361.764856:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103746560:12345-0@lo:400:kworker.0 Request processed in 99us (3461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.764864:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658361.764881:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658361.764887:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103746432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658361.764917:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103746432:12345-0@lo:400:kworker.0 Request processed in 30us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.764923:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658361.764979:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103746560:0@lo:400:kworker.0 00000100:00100000:0.0:1788658361.765011:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103746432:0@lo:400:kworker.0 00000100:00080000:2.0:1788658361.765309:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658361.771902:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746688 00000100:00100000:0.0:1788658361.771919:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746688 00000100:00100000:0.0:1788658361.772081:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658361.772093:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103746688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658361.772222:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103746688:12345-0@lo:400:kworker.0 Request processed in 131us (9906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.772231:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658361.774713:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103746688:0@lo:400:kworker.0 00000100:00080000:2.0:1788658361.774929:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658362.077116:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658362.269464:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658362.269501:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103746944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658362.269574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658362.269643:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103746944 00000100:00100000:1.0:1788658362.269651:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103746944 00000100:00100000:1.0:1788658362.269727:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658362.269737:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103746944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658362.269774:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658362.269819:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103746944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658362.269826:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788658362.269888:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005ab480 x1875544103746944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658362.269928:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103746944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788658363.100850:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658364.128631:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658365.103270:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658365.103473:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456704 00000100:00100000:2.0:1788658365.103488:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456704 00000100:00100000:2.0:1788658365.103561:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:2.0:1788658365.103572:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:5592:x1875544076456704:12345-192.168.202.3@tcp:101: 00010000:00010000:2.0:1788658365.103593:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658365.103613:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd600/0xf657f176650eab01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ac9f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658365.103646:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd600/0xf657f176650eab01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac9f expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658365.103658:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd600/0xf657f176650eab01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac9f expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658365.103705:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd600, rc 0) 00000100:00100000:2.0:1788658365.103978:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5592:x1875544076456704:12345-192.168.202.3@tcp:101: Request processed in 405us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658365.103987:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:3.0:1788658365.113064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658365.116715:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456832 00000100:00100000:0.0:1788658365.116737:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456832 00000100:00100000:0.0:1788658365.117071:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00100000:0.0:1788658365.117084:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5592:x1875544076456832:12345-192.168.202.3@tcp:501: 00000100:00100000:0.0:1788658365.117478:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5592:x1875544076456832:12345-192.168.202.3@tcp:501: Request processed in 395us (4423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658365.117487:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00100000:3.0:1788658365.119794:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658365.129394:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076456960 00000100:00100000:1.0:1788658365.129412:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076456960 00000100:00100000:1.0:1788658365.129482:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:1.0:1788658365.129493:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5592:x1875544076456960:12345-192.168.202.3@tcp:503: 00000100:00100000:1.0:1788658365.129795:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5592:x1875544076456960:12345-192.168.202.3@tcp:503: Request processed in 303us (10009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658365.129804:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:3.0:1788658365.135633:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658365.135806:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457088 00000100:00100000:1.0:1788658365.135824:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457088 00000100:00100000:1.0:1788658365.136241:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:1.0:1788658365.136258:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:6087:x1875544076457088:12345-192.168.202.3@tcp:502: 00000100:00100000:1.0:1788658365.136631:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:6087:x1875544076457088:12345-192.168.202.3@tcp:502: Request processed in 376us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658365.136641:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:3.0:1788658365.140086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658365.156800:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457216 00000100:00100000:2.0:1788658365.156817:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457216 00000100:00100000:2.0:1788658365.156899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:2.0:1788658365.156911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:6087:x1875544076457216:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658365.157256:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:6087:x1875544076457216:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 345us (17514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658365.157272:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 167 00010000:00010000:2.0:1788658365.158253:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658365.161186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658365.162292:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457344 00000100:00100000:2.0:1788658365.162309:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457344 00000100:00100000:2.0:1788658365.162395:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:2.0:1788658365.162407:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5592:x1875544076457344:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658365.162425:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658365.162445:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cdc00/0xf657f176650eab08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aca6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658365.162476:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cdc00/0xf657f176650eab08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aca6 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658365.162489:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cdc00/0xf657f176650eab08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aca6 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658365.162498:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cdc00, rc 0) 00000100:00100000:2.0:1788658365.162574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076457344:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 169us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658365.162581:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:3.0:1788658365.165796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658365.166055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457472 00000100:00100000:0.0:1788658365.166068:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457472 00000100:00100000:0.0:1788658365.166144:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 169 00000100:00100000:0.0:1788658365.166165:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076457472:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658365.166549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076457472:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 385us (765us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658365.166559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 169 00010000:00010000:1.0:1788658366.172865:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658366.366002:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658366.366033:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103747072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658366.367110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658366.377028:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103747072 00000100:00100000:2.0:1788658366.377050:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103747072 00000100:00080000:3.0:1788658366.377146:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658366.380135:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658366.380167:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103747072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658366.380221:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658366.380339:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103747072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (13235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658366.380372:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788658366.380519:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b0a680 x1875544103747072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658366.380544:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103747072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658366.633137:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658366.633224:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457600 00000100:00100000:3.0:1788658366.633236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457600 00000100:00100000:3.0:1788658366.633305:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 170 00000100:00100000:3.0:1788658366.633317:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076457600:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658366.633842:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076457600:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 523us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658366.633853:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 170 00000100:00100000:3.0:1788658366.653584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658366.653865:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457728 00000100:00100000:0.0:1788658366.653877:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457728 00000100:00100000:0.0:1788658366.653957:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658366.653970:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076457728:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658366.654066:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076457728:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 100us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658366.654073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00080000:3.0:1788658366.654605:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658366.654797:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658366.654886:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658366.655207:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457856 00000100:00100000:1.0:1788658366.655214:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457856 00000100:00100000:1.0:1788658366.655324:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076457984 00000100:00100000:1.0:1788658366.655327:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076457984 00000100:00100000:0.0:1788658366.655375:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:0.0:1788658366.655387:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076457856:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658366.655445:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076457856:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 61us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658366.655453:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00080000:3.0:1788658366.655979:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658366.659535:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658366.670600:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:1.0:1788658366.670623:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2353:x1875544076457984:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658366.670758:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2353:x1875544076457984:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 142us (15869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658366.670776:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:1.0:1788658366.877853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103747200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.877947:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658366.878002:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103747712:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878034:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658366.878065:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788658366.878071:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103747328:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878095:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658366.878114:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103747840:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878140:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658366.878168:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103747456:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878193:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658366.878213:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658366.878218:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103747584:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878239:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658366.878283:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103747712 00000100:00100000:1.0:1788658366.878291:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103747712 00000100:00100000:1.0:1788658366.878364:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103747328 00000100:00100000:1.0:1788658366.878368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103747328 00000100:00100000:1.0:1788658366.878381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103747456 00000100:00100000:1.0:1788658366.878384:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103747456 00000100:00100000:1.0:1788658366.878401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658366.878411:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103747712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878469:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103747712:12345-0@lo:400:kworker.0 Request processed in 59us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658366.878477:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658366.878506:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788658366.878512:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878542:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103747328:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658366.878549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788658366.878559:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788658366.878565:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103747456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878597:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103747456:12345-0@lo:400:kworker.0 Request processed in 32us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658366.878603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788658366.878631:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103747840 00000100:00100000:1.0:1788658366.878635:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103747840 00000100:00100000:1.0:1788658366.878691:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103747584 00000100:00100000:1.0:1788658366.878694:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103747584 00000100:00100000:1.0:1788658366.878710:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658366.878716:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103747840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878754:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103747840:12345-0@lo:400:kworker.0 Request processed in 38us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658366.878761:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658366.878772:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658366.878778:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103747584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878805:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103747584:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658366.878812:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788658366.878854:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005aa680 x1875544103747584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658366.878884:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103747584:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878901:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103747456:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878934:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103747328:0@lo:400:kworker.0 00010000:00080000:1.0:1788658366.878945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005a9f80 x1875544103747840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658366.878954:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103747840:0@lo:400:kworker.0 00000100:00100000:1.0:1788658366.878964:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103747712:0@lo:400:kworker.0 00000100:00100000:2.0:1788658366.882495:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103747200 00000100:00100000:2.0:1788658366.882518:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103747200 00000100:00100000:2.0:1788658366.882594:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788658366.882606:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103747200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658366.883750:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103747200:12345-0@lo:400:kworker.0 Request processed in 1137us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658366.883764:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788658366.883831:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658366.883839:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658366.883893:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103747200:0@lo:400:kworker.0 00000020:00000080:3.0:1788658367.168314:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc17531170 20000000:00000080:3.0:1788658367.168342:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e56fc6ef800 uarg=0000000000000000 20000000:01000000:3.0:1788658367.168474:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788658367.168483:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788658367.168489:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788658367.170585:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788658367.171015:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788658367.180424:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788658367.180494:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788658367.180556:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788658367.181171:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788658367.181206:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181231:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57021d8e00/0xf657f176650ea884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea87d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181259:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea8df expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181279:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ea9aa expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181289:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181298:0:8507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181350:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181371:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 9 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658367.181388:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103747968:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658367.181531:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea9aa expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.181541:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea9aa expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658367.181551:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103748096:0@lo:104: 00000100:00100000:3.0:1788658367.182192:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658367.182254:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea8df expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.182286:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea8df expref: 18 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658367.182296:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103748224:0@lo:104: 00000100:00100000:3.0:1788658367.182328:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658367.184762:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788658367.184819:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748096 00000100:00100000:2.0:1788658367.184833:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748096 00000100:00100000:2.0:1788658367.185109:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748224 00000100:00100000:2.0:1788658367.185113:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748224 00000100:00100000:2.0:1788658367.185136:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658367.185147:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:8507:x1875544103748096:12345-0@lo:104: 00010000:00010000:2.0:1788658367.185170:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658367.185480:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658367.185489:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+4:8507:x1875544103748096:12345-0@lo:104: Request processed in 344us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658367.185497:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658367.185520:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788658367.185543:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff956850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:8507:x1875544103748224:12345-0@lo:104: 00010000:00010000:2.0:1788658367.185552:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.186301:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57021d8e00/0xf657f176650ea884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ea87d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.186318:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e57021d8e00/0xf657f176650ea884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ea87d expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658367.186335:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103748352:0@lo:104: 00000100:00100000:3.0:1788658367.186393:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658367.186430:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788658367.186439:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788658367.186461:0:8507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658367.186488:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103748096:0@lo:104: 00000100:00100000:3.0:1788658367.186498:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103748224:0@lo:104: 00000100:00100000:3.0:1788658367.187465:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658367.187701:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076458112 00000100:00100000:1.0:1788658367.187710:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076458112 00010000:00010000:1.0:1788658367.187747:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658367.187794:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1788658367.187808:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2352:x1875544076458112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658367.187824:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658367.187830:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.187843:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.187867:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658367.188305:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2352:x1875544076458112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 499us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658367.188329:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00010000:00010000:1.0:1788658367.188408:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cc000/0xf657f176650eaa6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac6e expref: 9 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658367.188423:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103747968:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658367.190088:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658367.190132:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658367.190149:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff956850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:8507:x1875544103748224:12345-0@lo:104: Request processed in 4601us (7813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658367.190163:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788658367.190238:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748352 00000100:00100000:2.0:1788658367.190247:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748352 00000100:00100000:2.0:1788658367.190303:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788658367.190312:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:8507:x1875544103748352:12345-0@lo:104: 00010000:00010000:2.0:1788658367.190334:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190521:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658367.190530:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190538:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0030a00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658367.190543:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190553:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658367.190588:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658367.190595:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658367.190649:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190656:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658367.190721:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190731:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0030a00/0xf657f176650ea8df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea8e6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190749:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658367.190753:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190758:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0031800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658367.190761:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190768:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658367.190775:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658367.190780:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658367.190820:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190826:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658367.190833:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190839:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0031800/0xf657f176650ea87d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.190849:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658367.190851:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658367.190853:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658367.190903:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103748480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658367.191092:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875544103748352:0@lo:104: 00010000:00010000:1.0:1788658367.191139:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658367.191641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658367.191779:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658367.191798:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103748608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658367.191833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658367.192067:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658367.192079:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679a00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658367.192083:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658367.192108:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658367.192116:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658367.192122:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658367.192166:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658367.192172:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658367.192194:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658367.192201:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1679a00/0xf657f176650ea9aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ea9b1 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658367.192223:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658367.192225:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658367.192227:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658367.192241:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103748736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658367.192752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658367.192812:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788658367.192824:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:8507:x1875544103748352:12345-0@lo:104: Request processed in 2511us (6429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658367.192835:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788658367.192877:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658367.193330:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748480 00000100:00100000:1.0:1788658367.193342:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748480 00010000:00010000:1.0:1788658367.193472:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea8df expref: 19 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658367.193511:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748608 00000100:00100000:1.0:1788658367.193515:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748608 00010000:00010000:1.0:1788658367.193529:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57021d8e00/0xf657f176650ea884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea87d expref: 20 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658367.193553:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658367.193562:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+20:3304:x1875544103748480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658367.193591:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658367.193599:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea8df expref: 20 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.193611:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea8df expref: 20 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.193629:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679c00/0xf657f176650ea8e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea8df expref: 20 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.193683:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658367.193750:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103748480:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658367.193758:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658367.193775:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788658367.193782:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+18:3304:x1875544103748608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658367.194093:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658367.194099:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57021d8e00/0xf657f176650ea884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea87d expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.194108:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57021d8e00/0xf657f176650ea884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea87d expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.194118:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d8e00/0xf657f176650ea884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea87d expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658367.194130:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658367.194158:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+17:3304:x1875544103748608:12345-0@lo:103:ldlm_bl.0 Request processed in 376us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658367.194165:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658367.194403:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748736 00000100:00100000:3.0:1788658367.194410:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748736 00010000:00010000:3.0:1788658367.194434:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9aa expref: 17 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658367.194457:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658367.194463:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+17:3306:x1875544103748736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658367.194472:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658367.194477:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ea9aa expref: 17 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.194500:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ea9aa expref: 17 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.194511:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d9600/0xf657f176650ea9b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ea9aa expref: 17 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.194524:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.194533:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.194554:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.194561:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.194568:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.195042:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.195048:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfa00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658367.195053:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.195062:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.195091:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658367.195104:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658367.195159:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+16:3306:x1875544103748736:12345-0@lo:103:ldlm_bl.0 Request processed in 695us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658367.195168:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658367.195216:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103748736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658367.195249:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103748608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658367.195260:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103748480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658367.195345:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658367.195363:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658367.195370:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dfa00/0xf657f176650eab0f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658367.216458:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658367.389115:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103748864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658367.389229:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658367.389341:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748864 00000100:00100000:0.0:1788658367.389349:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748864 00000100:00100000:0.0:1788658367.389409:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658367.389420:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103748864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658367.389466:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658367.389554:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103748864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658367.389562:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788658367.389625:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b0ad80 x1875544103748864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658367.389648:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103748864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788658368.237453:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658368.751886:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658368.751959:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076458240 00000100:00100000:3.0:1788658368.751972:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076458240 00000100:00100000:3.0:1788658368.752086:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:3.0:1788658368.752099:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:5592:x1875544076458240:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658368.752117:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658368.752138:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8acad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658368.752169:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658368.752182:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658368.752192:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29df600, rc 0) 00000100:00100000:3.0:1788658368.752276:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076458240:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 180us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.752284:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:3.0:1788658368.757563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658368.759211:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076458368 00000100:00100000:2.0:1788658368.759224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076458368 00000100:00100000:2.0:1788658368.759293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 173 00000100:00100000:2.0:1788658368.759304:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076458368:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658368.759643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076458368:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 339us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658368.759653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 173 00000100:00100000:1.0:1788658368.766040:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658368.766080:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076458496 00000100:00100000:1.0:1788658368.766093:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076458496 00000100:00100000:1.0:1788658368.766142:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 174 00000100:00100000:1.0:1788658368.766154:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076458496:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658368.766381:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:5592:x1875544076458496:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 229us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658368.766398:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 174 00000100:00100000:1.0:1788658368.782690:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658368.782734:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076458624 00000100:00100000:1.0:1788658368.782747:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076458624 00000100:00100000:1.0:1788658368.782809:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 175 00000100:00100000:1.0:1788658368.782822:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:6150:x1875544076458624:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658368.783072:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:6150:x1875544076458624:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 253us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658368.783080:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 175 00000100:00100000:1.0:1788658368.787952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658368.790227:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076458752 00000100:00100000:2.0:1788658368.790247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076458752 00000100:00100000:2.0:1788658368.790329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 176 00000100:00100000:2.0:1788658368.790341:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:6150:x1875544076458752:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658368.791006:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:6150:x1875544076458752:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 663us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658368.791017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 176 10000000:01000000:0.0:1788658369.116754:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658369.116762:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56fef6c800 from 4 10000000:01000000:0.0:1788658369.116767:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658369.116823:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.116837:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.116850:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658369.116880:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103748992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.116953:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.117018:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658369.117069:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103748992 00000100:00100000:2.0:1788658369.117079:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103748992 00000100:00100000:2.0:1788658369.117130:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788658369.117140:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103748992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658369.117153:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658369.117169:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eab1d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.117193:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eab1d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.117204:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab1d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.117232:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd400, rc 0) 00000100:00100000:2.0:1788658369.117289:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103748992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658369.117296:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788658369.117387:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103748992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658369.117404:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.117413:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658369.117485:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.117513:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.117538:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658369.117582:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103749120 00000100:00100000:2.0:1788658369.117587:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103749120 00000100:00100000:2.0:1788658369.117619:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788658369.117626:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103749120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.117922:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103749120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658369.117930:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788658369.118030:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.118062:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.118102:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.118125:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658369.118138:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103749248 00000100:00100000:0.0:1788658369.118141:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103749248 00000100:00100000:0.0:1788658369.118166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788658369.118172:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103749248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.118303:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103749248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658369.118309:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788658369.118358:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.118537:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8581:1875544103749376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658369.118571:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.118589:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103749376 00000100:00100000:0.0:1788658369.118593:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103749376 00000100:00100000:0.0:1788658369.118614:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788658369.118619:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:8581:x1875544103749376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658369.118772:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:8581:x1875544103749376:12345-0@lo:502:llog_process_th.0 Request processed in 151us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658369.118788:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788658369.118821:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658369.118833:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8581:1875544103749376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658369.118852:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658369.118863:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658369.118865:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788658369.118874:0:8581:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56fef6c800 00000020:00000080:0.0:1788658369.118876:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788658369.118943:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8581:1875544103749504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658369.118974:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.118992:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103749504 00000100:00100000:0.0:1788658369.118995:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103749504 00000100:00100000:0.0:1788658369.119016:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788658369.119022:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:8581:x1875544103749504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658369.119126:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:8581:x1875544103749504:12345-0@lo:502:llog_process_th.0 Request processed in 104us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658369.119134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788658369.119163:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658369.119173:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8581:1875544103749504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658369.119191:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658369.119195:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658369.119196:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788658369.119199:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788658369.119248:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788658369.119260:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658369.119269:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.119287:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658369.119297:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658369.119299:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e57014ee800 from 4 10000000:01000000:0.0:1788658369.119302:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658369.119340:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.119348:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.119357:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658369.119370:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.119396:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.119408:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658369.119420:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103749632 00000100:00100000:0.0:1788658369.119423:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103749632 00000100:00100000:0.0:1788658369.119443:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788658369.119448:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103749632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658369.119456:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658369.119469:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eab2b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.119489:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eab2b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.119509:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab2b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.119518:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79000, rc 0) 00000100:00100000:0.0:1788658369.119544:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103749632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658369.119550:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788658369.119577:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658369.119590:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.119599:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658369.119636:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.119660:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.119700:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658369.119711:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103749760 00000100:00100000:0.0:1788658369.119714:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103749760 00000100:00100000:0.0:1788658369.119734:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788658369.119740:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103749760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.119954:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103749760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658369.119960:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788658369.119987:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.120018:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.120046:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.120056:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658369.120066:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103749888 00000100:00100000:0.0:1788658369.120068:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103749888 00000100:00100000:0.0:1788658369.120085:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788658369.120090:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103749888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.120185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103749888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658369.120192:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788658369.120221:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103749888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.127079:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8582:1875544103750016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658369.127168:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658369.127222:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658369.128945:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750016 00000100:00100000:3.0:1788658369.128962:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750016 00000100:00100000:3.0:1788658369.129025:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788658369.129037:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:8582:x1875544103750016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658369.129336:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:8582:x1875544103750016:12345-0@lo:502:llog_process_th.0 Request processed in 290us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658369.129344:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788658369.129557:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8582:1875544103750016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658369.129599:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658369.129610:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658369.129612:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788658369.129620:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e57014ee800 00000020:00000080:2.0:1788658369.129623:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658369.129730:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8582:1875544103750144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658369.129777:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658369.129807:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658369.131568:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750144 00000100:00100000:3.0:1788658369.131581:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750144 00000100:00100000:3.0:1788658369.131648:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788658369.131660:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:8582:x1875544103750144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658369.131938:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:8582:x1875544103750144:12345-0@lo:502:llog_process_th.0 Request processed in 279us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658369.131946:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788658369.132878:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8582:1875544103750144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658369.132925:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658369.132942:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658369.132944:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788658369.132950:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788658369.133138:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788658369.133162:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658369.133175:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.133187:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658369.133198:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658369.133201:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56f44c2000 from 4 10000000:01000000:0.0:1788658369.133204:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658369.133243:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.133251:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658369.133272:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658369.133297:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103750272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658369.133364:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658369.133409:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658369.134659:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750272 00000100:00100000:2.0:1788658369.134688:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750272 00000100:00100000:2.0:1788658369.134737:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788658369.134748:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103750272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658369.134765:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658369.134783:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eab39 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.134811:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eab39 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.134824:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab39 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.134833:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc800, rc 0) 00000100:00100000:2.0:1788658369.134905:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103750272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658369.134913:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788658369.134971:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103750272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658369.134991:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.135001:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658369.135075:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103750400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.135116:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658369.135144:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658369.135157:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750400 00000100:00100000:2.0:1788658369.135161:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750400 00000100:00100000:2.0:1788658369.135182:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788658369.135188:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103750400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.135463:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103750400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658369.135471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788658369.135498:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103750400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.135524:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103750528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.135558:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658369.135570:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658369.135582:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750528 00000100:00100000:2.0:1788658369.135585:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750528 00000100:00100000:2.0:1788658369.135602:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788658369.135607:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103750528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.135754:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103750528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658369.135761:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788658369.135792:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103750528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658369.135953:0:8584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8584:1875544103750656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658369.135984:0:8584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658369.136001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750656 00000100:00100000:2.0:1788658369.136010:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750656 00000100:00100000:2.0:1788658369.136030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788658369.136035:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:8584:x1875544103750656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658369.136148:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:8584:x1875544103750656:12345-0@lo:502:llog_process_th.0 Request processed in 112us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658369.136155:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788658369.136182:0:8584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658369.136193:0:8584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8584:1875544103750656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658369.136213:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658369.136221:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658369.136224:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788658369.136231:0:8584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56f44c2000 00000020:00000080:2.0:1788658369.136234:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658369.136572:0:8584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8584:1875544103750784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658369.136606:0:8584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658369.136626:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750784 00000100:00100000:2.0:1788658369.136630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750784 00000100:00100000:2.0:1788658369.136651:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788658369.136657:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:8584:x1875544103750784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658369.136787:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:8584:x1875544103750784:12345-0@lo:502:llog_process_th.0 Request processed in 128us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658369.136794:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788658369.136822:0:8584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658369.136834:0:8584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:8584:1875544103750784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658369.136851:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658369.136856:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658369.136861:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788658369.136865:0:8584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788658369.136909:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788658369.136926:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658369.136936:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.136946:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658369.244994:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658370.269068:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658371.298733:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658371.491206:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658371.491241:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103750912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658371.491339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658371.491448:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103750912 00000100:00100000:1.0:1788658371.491459:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103750912 00000100:00100000:1.0:1788658371.491530:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658371.491751:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103750912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658371.491800:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658371.491861:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103750912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658371.491868:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788658371.491898:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658371.491987:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005a8700 x1875544103750912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658371.492011:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103750912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658371.760192:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658371.760233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658371.760420:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076458880 00000100:00100000:2.0:1788658371.760433:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076458880 00000100:00100000:2.0:1788658371.760486:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:2.0:1788658371.760497:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076458880:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658371.760571:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076458880:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 76us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658371.760580:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:2.0:1788658371.760627:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459136 00000100:00100000:2.0:1788658371.760631:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459136 00000100:00100000:2.0:1788658371.760706:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:2.0:1788658371.760892:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076459136:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658371.761006:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076459136:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 292us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658371.761013:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658371.761070:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658371.761158:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1788658371.762015:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658371.764648:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459008 00000100:00100000:2.0:1788658371.764680:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459008 00000100:00100000:2.0:1788658371.764906:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:2.0:1788658371.764921:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076459008:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658371.765088:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459264 00000100:00100000:1.0:1788658371.765094:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459264 00000100:00100000:1.0:1788658371.765125:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:1.0:1788658371.765133:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076459264:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658371.765226:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076459264:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 93us (4067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658371.765234:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:2.0:1788658371.765519:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076459008:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 602us (5259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658371.765528:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00080000:2.0:1788658371.765560:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658371.765565:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658371.997003:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103751424:0@lo:400:kworker.0 00000100:00100000:2.0:1788658371.997094:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658371.997164:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788658371.997171:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103751040:0@lo:400:kworker.0 00000100:00100000:2.0:1788658371.997201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658371.997229:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103751552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658371.997255:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658371.997282:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103751168:0@lo:400:kworker.0 00000100:00100000:2.0:1788658371.997305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658371.997320:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103751680:0@lo:400:kworker.0 00000100:00100000:2.0:1788658371.997339:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658371.997354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658371.997555:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103751296:0@lo:400:kworker.0 00000100:00100000:2.0:1788658371.997581:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658371.997615:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751424 00000100:00100000:2.0:1788658371.997624:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751424 00000100:00100000:2.0:1788658371.997691:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751680 00000100:00100000:2.0:1788658371.997694:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751680 00000100:00100000:2.0:1788658371.997718:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658371.997834:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751552 00000100:00100000:1.0:1788658371.997838:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751552 00000100:00100000:1.0:1788658371.997871:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751168 00000100:00100000:1.0:1788658371.997874:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751168 00000100:00100000:1.0:1788658371.997884:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751296 00000100:00100000:1.0:1788658371.997886:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751296 00000100:00100000:1.0:1788658371.997898:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788658371.997908:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103751552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658371.997984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103751552:12345-0@lo:400:kworker.0 Request processed in 65us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658371.997992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788658371.998009:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658371.998015:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103751168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658371.998045:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103751168:12345-0@lo:400:kworker.0 Request processed in 30us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658371.998050:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658371.998061:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658371.998067:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103751296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658371.998092:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103751296:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658371.998112:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658371.998168:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103751424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658371.998200:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103751424:12345-0@lo:400:kworker.0 Request processed in 34us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658372.005856:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751040 00000100:00100000:3.0:1788658372.005874:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751040 00000100:00100000:3.0:1788658372.005944:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788658372.005955:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103751040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658372.006196:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658372.006266:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103751296:0@lo:400:kworker.0 00000100:00100000:1.0:1788658372.006281:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103751168:0@lo:400:kworker.0 00000100:00100000:1.0:1788658372.006320:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103751552:0@lo:400:kworker.0 00010000:00080000:1.0:1788658372.006338:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079d500 x1875544103751424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658372.006348:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103751424:0@lo:400:kworker.0 00000100:00100000:1.0:1788658372.006380:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103751680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658372.006494:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103751680:12345-0@lo:400:kworker.0 Request processed in 288us (9152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658372.006504:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788658372.006539:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079f480 x1875544103751680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658372.006551:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103751680:0@lo:400:kworker.0 00000100:00100000:3.0:1788658372.011215:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103751040:12345-0@lo:400:kworker.0 Request processed in 5254us (14003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658372.011230:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788658372.011322:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103751040:0@lo:400:kworker.0 00000100:00080000:0.0:1788658372.012244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658372.012251:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658372.015237:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788658372.317909:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658372.510223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658372.510256:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103751808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658372.510338:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658372.510417:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751808 00000100:00100000:1.0:1788658372.510437:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751808 00000100:00100000:1.0:1788658372.510642:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658372.510656:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103751808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658372.510727:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658372.511000:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103751808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 346us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658372.511008:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788658372.514727:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005ab800 x1875544103751808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658372.514890:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103751808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788658373.341231:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658374.238305:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788658374.364878:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658375.396071:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658376.414082:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658376.605626:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658376.605654:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103751936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658376.605786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658376.605862:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103751936 00000100:00100000:0.0:1788658376.605871:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103751936 00000100:00100000:0.0:1788658376.605951:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658376.605963:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103751936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658376.606002:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658376.606051:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103751936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658376.606059:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788658376.606120:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b0ad80 x1875544103751936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658376.606291:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103751936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658376.606696:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658376.893613:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658376.893662:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658376.893735:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459520 00000100:00100000:2.0:1788658376.893748:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459520 00000100:00100000:2.0:1788658376.893817:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:2.0:1788658376.893829:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076459520:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658376.894251:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076459520:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658376.894263:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00080000:2.0:1788658376.894289:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658376.894785:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459392 00000100:00100000:3.0:1788658376.894793:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459392 00000100:00100000:3.0:1788658376.894843:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 194 00000100:00100000:3.0:1788658376.894852:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076459392:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658376.895132:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076459392:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 279us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658376.895140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 194 00000100:00100000:2.0:1788658376.913755:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658376.913796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658376.913828:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459648 00000100:00100000:2.0:1788658376.913839:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459648 00000100:00100000:2.0:1788658376.913911:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459776 00000100:00100000:2.0:1788658376.913914:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459776 00000100:00100000:2.0:1788658376.913941:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658376.913952:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2350:x1875544076459648:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:2.0:1788658376.913995:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eaa7c 00000100:00080000:2.0:1788658376.914006:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9e56fef6d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658376.914048:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788658376.914504:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+2:2350:x1875544076459648:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 552us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658376.914513:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658376.914547:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1788658376.914556:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2350:x1875544076459776:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:2.0:1788658376.914583:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eaa83 00000100:00080000:2.0:1788658376.914592:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9e56fef69800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658376.914616:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788658376.914830:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+2:2350:x1875544076459776:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 275us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658376.914836:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00080000:2.0:1788658376.914856:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658376.914860:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788658376.914926:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658376.915040:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658377.120023:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103752448:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658377.120175:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788658377.120181:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103752064:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120223:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658377.120243:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103752576:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120291:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658377.120323:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103752192:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658377.120362:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103752704:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658377.120424:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658377.120430:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103752320:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658377.120483:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752448 00000100:00100000:2.0:1788658377.120492:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752448 00000100:00100000:2.0:1788658377.120544:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752704 00000100:00100000:2.0:1788658377.120548:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752704 00000100:00100000:2.0:1788658377.120586:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788658377.120596:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103752448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120657:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103752448:12345-0@lo:400:kworker.0 Request processed in 62us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658377.120691:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788658377.120725:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658377.120732:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103752704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120765:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103752704:12345-0@lo:400:kworker.0 Request processed in 34us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658377.120771:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658377.120789:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752576 00000100:00100000:2.0:1788658377.120792:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752576 00000100:00100000:2.0:1788658377.120815:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752192 00000100:00100000:2.0:1788658377.120817:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752192 00000100:00100000:2.0:1788658377.120827:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752320 00000100:00100000:2.0:1788658377.120829:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752320 00000100:00100000:2.0:1788658377.120841:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788658377.120847:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103752576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120878:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103752576:12345-0@lo:400:kworker.0 Request processed in 31us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658377.120884:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788658377.120904:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658377.120909:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103752192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120938:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103752192:12345-0@lo:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658377.120944:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658377.120954:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658377.120960:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103752320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.120985:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103752320:12345-0@lo:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658377.120991:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788658377.121014:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658377.121019:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658377.121061:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103752576:0@lo:400:kworker.0 00010000:00080000:2.0:1788658377.121078:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079d880 x1875544103752448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658377.121086:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103752448:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.121118:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103752320:0@lo:400:kworker.0 00000100:00100000:2.0:1788658377.121126:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103752192:0@lo:400:kworker.0 00010000:00080000:2.0:1788658377.121133:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079ce00 x1875544103752704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658377.121141:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103752704:0@lo:400:kworker.0 00000100:00100000:0.0:1788658377.123123:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752064 00000100:00100000:0.0:1788658377.123139:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752064 00000100:00100000:0.0:1788658377.123211:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788658377.123221:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103752064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658377.123307:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103752064:12345-0@lo:400:kworker.0 Request processed in 87us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658377.123314:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788658377.123537:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103752064:0@lo:400:kworker.0 00010000:00010000:0.0:1788658377.437725:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658377.631145:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658377.631178:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103752832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658377.631263:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658377.631860:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752832 00000100:00100000:0.0:1788658377.631871:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752832 00000100:00100000:0.0:1788658377.631936:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658377.631946:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103752832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658377.631986:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658377.632046:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103752832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658377.632054:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788658377.632100:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005ab800 x1875544103752832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658377.632121:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103752832:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788658377.697385:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:3.0:1788658377.697396:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e56fef68000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:3.0:1788658377.697444:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fef68000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 for lustre-OST0000 00000020:00000080:3.0:1788658377.697637:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56fef6d000 for lustre-OST0000 00010000:00010000:2.0:1788658378.466641:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658379.487309:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658380.253904:0:9053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing yml_node 00010000:00010000:0.0:1788658380.511597:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658380.804224:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:3.0:1788658380.804235:0:7647:0:(genops.c:885:class_export_put()) final put ffff9e56fef6e000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:1.0:1788658380.804369:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fef6e000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 for lustre-OST0001 00000020:00000080:1.0:1788658380.804427:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56fef69800 for lustre-OST0001 00010000:00010000:2.0:1788658381.553187:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658381.725008:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658381.725039:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fabd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103752960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658381.725121:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658381.725272:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103752960 00000100:00100000:0.0:1788658381.725285:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103752960 00000100:00100000:0.0:1788658381.725363:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658381.725375:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103752960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658381.725435:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658381.725490:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103752960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658381.725497:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788658381.725539:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56fabd3480 x1875544103752960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658381.725693:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658381.725878:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fabd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103752960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658381.998966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658381.999023:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658381.999069:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460032 00000100:00100000:0.0:1788658381.999084:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460032 00000100:00100000:0.0:1788658381.999176:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:0.0:1788658381.999190:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076460032:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658381.999298:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076460032:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 110us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658381.999306:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00080000:0.0:1788658381.999347:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658381.999788:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076459904 00000100:00100000:3.0:1788658381.999794:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076459904 00000100:00100000:3.0:1788658381.999829:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 196 00000100:00100000:3.0:1788658381.999835:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076459904:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658381.999884:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076459904:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 49us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658381.999891:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 196 00000100:00100000:3.0:1788658382.247602:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658382.247983:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103753216:0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.248063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658382.248124:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658382.248131:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103753344:0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.248157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658382.248211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753216 00000100:00100000:0.0:1788658382.248220:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753216 00000100:00100000:0.0:1788658382.248269:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753344 00000100:00100000:0.0:1788658382.248272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753344 00000100:00100000:0.0:1788658382.248333:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658382.248343:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103753216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.248398:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103753216:12345-0@lo:400:kworker.0 Request processed in 57us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658382.248405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658382.248424:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788658382.248430:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.248456:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103753344:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658382.248462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788658382.248488:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658382.248537:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103753344:0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.248548:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103753216:0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.253447:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103753472:0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.253545:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658382.253602:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103753088:0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.253633:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658382.253710:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753088 00000100:00100000:3.0:1788658382.253732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753088 00000100:00100000:3.0:1788658382.253787:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788658382.253797:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103753088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.253856:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103753088:12345-0@lo:400:kworker.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658382.253864:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788658382.253920:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103753088:0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.254159:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753472 00000100:00100000:0.0:1788658382.254165:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753472 00000100:00100000:0.0:1788658382.254215:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658382.254224:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103753472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.254277:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103753472:12345-0@lo:400:kworker.0 Request processed in 55us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658382.254283:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788658382.254328:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700bb4000 x1875544103753472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658382.254341:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103753472:0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.258759:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103753600:0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.258839:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658382.258893:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753600 00000100:00100000:3.0:1788658382.258902:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753600 00000100:00100000:3.0:1788658382.258959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658382.258969:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103753600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.259026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103753600:12345-0@lo:400:kworker.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658382.259034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788658382.259073:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658382.259105:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103753600:0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.261984:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103753728:0@lo:400:kworker.0 00000100:00100000:3.0:1788658382.262069:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658382.264472:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753728 00000100:00100000:0.0:1788658382.264486:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753728 00000100:00100000:0.0:1788658382.264570:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658382.264581:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103753728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658382.264690:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103753728:12345-0@lo:400:kworker.0 Request processed in 111us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658382.264697:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788658382.264760:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700bb6a00 x1875544103753728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658382.264954:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658382.265381:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103753728:0@lo:400:kworker.0 00010000:00010000:2.0:1788658382.559605:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658382.749517:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103753856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658382.749620:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658382.750015:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753856 00000100:00100000:1.0:1788658382.750115:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753856 00000100:00100000:1.0:1788658382.750238:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658382.750249:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103753856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658382.750297:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658382.751160:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103753856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 909us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658382.751172:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788658382.758557:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700bb7800 x1875544103753856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658382.758593:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103753856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788658383.582383:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658384.605060:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658385.629167:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658386.394384:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788658386.655199:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658386.860139:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103753984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658386.860235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658386.861104:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103753984 00000100:00100000:0.0:1788658386.861116:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103753984 00000100:00100000:0.0:1788658386.861202:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658386.861214:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103753984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658386.861259:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788658386.861355:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658386.877895:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103753984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16668us (17643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658386.877915:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788658386.879353:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c8338a80 x1875544103753984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658386.879387:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103753984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658387.116124:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658387.116201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658387.116239:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460160 00000100:00100000:3.0:1788658387.116252:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460160 00000100:00100000:3.0:1788658387.116315:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 198 00000100:00100000:3.0:1788658387.116326:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2351:x1875544076460160:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658387.116413:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2351:x1875544076460160:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.116423:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 198 00000100:00100000:3.0:1788658387.116466:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460288 00000100:00100000:3.0:1788658387.116470:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460288 00000100:00100000:3.0:1788658387.116517:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:3.0:1788658387.116524:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076460288:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658387.116565:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076460288:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 41us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.116572:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00080000:3.0:1788658387.116757:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658387.358288:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103754240:0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.358377:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658387.358514:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103754752:0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.358545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658387.358582:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658387.358588:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103754368:0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.358624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658387.358661:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103754240 00000100:00100000:3.0:1788658387.358698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103754240 00000100:00100000:3.0:1788658387.358747:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103754368 00000100:00100000:3.0:1788658387.358750:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103754368 00000100:00100000:3.0:1788658387.358782:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658387.358791:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103754240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.358852:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103754240:12345-0@lo:400:kworker.0 Request processed in 61us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.358860:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658387.358879:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658387.358885:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103754368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.358912:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103754368:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.358919:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658387.358950:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103754752 00000100:00100000:3.0:1788658387.358965:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103754752 00000100:00100000:3.0:1788658387.358999:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658387.359005:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103754752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.359037:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103754752:12345-0@lo:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.359043:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788658387.359067:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658387.359073:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658387.359110:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103754368:0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.359122:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103754240:0@lo:400:kworker.0 00010000:00080000:3.0:1788658387.359135:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56ff753480 x1875544103754752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658387.359147:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103754752:0@lo:400:kworker.0 00000100:00100000:0.0:1788658387.359506:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103754112:0@lo:400:kworker.0 00000100:00100000:0.0:1788658387.359551:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658387.359578:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103754624:0@lo:400:kworker.0 00000100:00100000:0.0:1788658387.359602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658387.359630:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658387.359637:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103754496:0@lo:400:kworker.0 00000100:00100000:0.0:1788658387.359677:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658387.359707:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103754496 00000100:00100000:0.0:1788658387.359718:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103754496 00000100:00100000:0.0:1788658387.359747:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658387.359754:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103754496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658387.359792:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103754496:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658387.359799:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788658387.359827:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56ff751500 x1875544103754496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658387.359836:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103754496:0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.360916:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103754112 00000100:00100000:3.0:1788658387.361475:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103754112 00000100:00100000:3.0:1788658387.361551:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788658387.361563:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103754112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.361725:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103754112:12345-0@lo:400:kworker.0 Request processed in 164us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.361735:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788658387.361781:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103754624 00000100:00100000:3.0:1788658387.361785:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103754624 00000100:00100000:3.0:1788658387.361826:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658387.361833:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103754624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658387.361869:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103754624:12345-0@lo:400:kworker.0 Request processed in 36us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.361882:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788658387.361902:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658387.361982:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103754112:0@lo:400:kworker.0 00000100:00100000:1.0:1788658387.362000:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103754624:0@lo:400:kworker.0 00010000:00010000:2.0:1788658387.683695:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658387.869007:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658387.869038:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103754880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658387.869132:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658387.869318:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103754880 00000100:00100000:1.0:1788658387.869328:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103754880 00000100:00100000:1.0:1788658387.869394:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658387.869406:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103754880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658387.869469:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658387.869528:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103754880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658387.869535:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788658387.869590:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c8338a80 x1875544103754880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658387.869610:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103754880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788658388.700964:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658389.724941:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788658390.056023:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:2.0:1788658390.751075:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658391.773054:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658391.972165:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658391.972197:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103755008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658391.972286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658391.972591:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755008 00000100:00100000:2.0:1788658391.972601:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755008 00000100:00100000:2.0:1788658391.972697:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658391.972708:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103755008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658391.972748:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658391.972800:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103755008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658391.972807:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788658391.972873:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788658391.974591:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c8339880 x1875544103755008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658391.974620:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103755008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658392.234777:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658392.234834:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658392.234951:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460416 00000100:00100000:0.0:1788658392.234966:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460416 00000100:00100000:0.0:1788658392.235042:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 200 00000100:00100000:0.0:1788658392.235077:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076460416:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658392.235179:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076460416:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 127us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658392.235187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 200 00000100:00100000:1.0:1788658392.235694:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460544 00000100:00100000:1.0:1788658392.235701:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460544 00000100:00100000:1.0:1788658392.235759:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:1.0:1788658392.235767:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076460544:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658392.235805:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076460544:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 40us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658392.235812:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00080000:3.0:1788658392.235871:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658392.484864:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103755264:0@lo:400:kworker.0 00000100:00100000:1.0:1788658392.484944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658392.485022:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658392.485030:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103755392:0@lo:400:kworker.0 00000100:00100000:0.0:1788658392.485160:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788658392.485222:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658392.485249:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103755648:0@lo:400:kworker.0 00000100:00100000:0.0:1788658392.485275:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658392.485297:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658392.485302:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103755520:0@lo:400:kworker.0 00000100:00100000:0.0:1788658392.485323:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658392.485366:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755136 00000100:00100000:0.0:1788658392.485376:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755136 00000100:00100000:0.0:1788658392.485431:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788658392.485443:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103755136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658392.485499:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103755136:12345-0@lo:400:kworker.0 Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658392.485507:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788658392.485545:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755648 00000100:00100000:0.0:1788658392.485549:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755648 00000100:00100000:0.0:1788658392.485587:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658392.485594:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103755648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658392.485626:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103755648:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658392.485632:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788658392.485650:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658392.485706:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103755136:0@lo:400:kworker.0 00010000:00080000:0.0:1788658392.485721:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700bb6680 x1875544103755648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658392.485733:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103755648:0@lo:400:kworker.0 00000100:00100000:1.0:1788658392.486213:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658392.489630:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755264 00000100:00100000:3.0:1788658392.489648:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755264 00000100:00100000:3.0:1788658392.489764:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755520 00000100:00100000:3.0:1788658392.489768:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755520 00000100:00100000:3.0:1788658392.489799:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755392 00000100:00100000:3.0:1788658392.489802:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755392 00000100:00100000:3.0:1788658392.489823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788658392.489834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103755264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658392.489944:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103755264:12345-0@lo:400:kworker.0 Request processed in 111us (4999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658392.489952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788658392.489969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788658392.489976:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103755520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658392.490030:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103755520:12345-0@lo:400:kworker.0 Request processed in 55us (4706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658392.490036:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788658392.490066:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788658392.490074:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103755392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658392.490105:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103755392:12345-0@lo:400:kworker.0 Request processed in 33us (3894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658392.490112:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788658392.490158:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658392.490544:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103755520:0@lo:400:kworker.0 00000100:00100000:1.0:1788658392.492906:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103755392:0@lo:400:kworker.0 00000100:00100000:1.0:1788658392.492926:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103755264:0@lo:400:kworker.0 00010000:00010000:0.0:1788658392.799111:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658392.988954:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103755776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658392.989055:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658392.989533:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755776 00000100:00100000:2.0:1788658392.989546:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755776 00000100:00100000:2.0:1788658392.989618:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658392.989628:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103755776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658392.989713:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658392.989779:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103755776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658392.989787:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788658392.989896:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c833a300 x1875544103755776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658392.989920:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103755776:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788658393.556630:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:1.0:1788658393.826849:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658394.845065:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658395.880878:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658395.967990:0:9491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 21:33:13 EDT 2026 00010000:00010000:1.0:1788658396.894030:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658397.098152:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658397.098178:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103755904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658397.098254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658397.098325:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103755904 00000100:00100000:2.0:1788658397.098334:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103755904 00000100:00100000:2.0:1788658397.098397:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658397.098407:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103755904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658397.098458:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658397.098508:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103755904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658397.098516:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788658397.098549:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658397.098585:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c8339500 x1875544103755904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658397.098605:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103755904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658397.357103:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658397.357157:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658397.357237:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460672 00000100:00100000:0.0:1788658397.357252:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460672 00000100:00100000:0.0:1788658397.357320:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 202 00000100:00100000:0.0:1788658397.357332:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076460672:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658397.357413:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076460672:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658397.357422:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 202 00000100:00100000:2.0:1788658397.357879:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460800 00000100:00100000:2.0:1788658397.357885:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460800 00000100:00100000:2.0:1788658397.357938:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:2.0:1788658397.357946:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076460800:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658397.357991:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076460800:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 47us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658397.358014:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00080000:3.0:1788658397.358343:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658397.598014:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103756032:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658397.598147:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103756544:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598175:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658397.598203:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658397.598209:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103756160:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598234:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658397.598261:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103756288:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598282:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658397.598296:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658397.598300:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103756416:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658397.598349:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756032 00000100:00100000:1.0:1788658397.598358:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756032 00000100:00100000:1.0:1788658397.598404:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788658397.598415:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103756032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598468:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103756032:12345-0@lo:400:kworker.0 Request processed in 54us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658397.598487:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788658397.598525:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756544 00000100:00100000:1.0:1788658397.598536:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756544 00000100:00100000:1.0:1788658397.598576:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658397.598583:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103756544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598615:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103756544:12345-0@lo:400:kworker.0 Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658397.598621:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658397.598640:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756160 00000100:00100000:1.0:1788658397.598644:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756160 00000100:00100000:1.0:1788658397.598685:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756288 00000100:00100000:1.0:1788658397.598689:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756288 00000100:00100000:1.0:1788658397.598704:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756416 00000100:00100000:1.0:1788658397.598707:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756416 00000100:00100000:1.0:1788658397.598719:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658397.598725:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103756160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598756:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103756160:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658397.598762:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658397.598773:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788658397.598778:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103756288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598809:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103756288:12345-0@lo:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658397.598814:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788658397.598823:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658397.598829:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103756416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598852:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103756416:12345-0@lo:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658397.598857:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788658397.598889:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658397.598893:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658397.598927:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103756416:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598938:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103756288:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598962:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103756160:0@lo:400:kworker.0 00000100:00100000:1.0:1788658397.598970:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103756032:0@lo:400:kworker.0 00010000:00080000:1.0:1788658397.598982:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700bb4e00 x1875544103756544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658397.598992:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103756544:0@lo:400:kworker.0 00010000:00010000:3.0:1788658397.920646:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658398.117595:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103756672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658398.118916:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658398.126394:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756672 00000100:00100000:2.0:1788658398.126421:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756672 00000100:00100000:2.0:1788658398.126493:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658398.126505:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103756672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658398.126559:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658398.126657:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103756672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658398.126860:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788658398.126985:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700bb4e00 x1875544103756672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658398.127009:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103756672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788658398.953448:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658399.964863:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658400.991610:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658402.013196:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658402.207208:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658402.207250:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103756800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658402.207343:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658402.207700:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756800 00000100:00100000:2.0:1788658402.207711:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756800 00000100:00100000:2.0:1788658402.207785:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658402.207796:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103756800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658402.207838:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658402.207903:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103756800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658402.207911:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788658402.208128:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658402.208164:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c8339500 x1875544103756800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658402.208186:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103756800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658402.477035:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658402.477090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658402.477118:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076460928 00000100:00100000:3.0:1788658402.477129:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076460928 00000100:00100000:3.0:1788658402.477182:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 204 00000100:00100000:3.0:1788658402.477194:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2353:x1875544076460928:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658402.477282:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2353:x1875544076460928:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 91us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.477290:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 204 00000100:00100000:3.0:1788658402.477790:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461056 00000100:00100000:3.0:1788658402.477796:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461056 00000100:00100000:3.0:1788658402.477836:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:3.0:1788658402.477843:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076461056:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658402.477892:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076461056:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 48us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.477899:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00080000:3.0:1788658402.477918:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658402.725913:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103756928:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658402.726098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103756928 00000100:00100000:3.0:1788658402.726108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103756928 00000100:00100000:3.0:1788658402.726159:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788658402.726173:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103756928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726242:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103756928:12345-0@lo:400:kworker.0 Request processed in 73us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.726250:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788658402.726307:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103756928:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726354:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103757056:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726383:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658402.726415:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757056 00000100:00100000:3.0:1788658402.726420:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757056 00000100:00100000:3.0:1788658402.726447:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788658402.726453:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103757056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726488:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103757056:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.726494:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788658402.726523:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103757056:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726574:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103757184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726614:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658402.726644:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757184 00000100:00100000:3.0:1788658402.726648:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757184 00000100:00100000:3.0:1788658402.726706:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788658402.726712:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103757184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726745:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103757184:12345-0@lo:400:kworker.0 Request processed in 33us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.726752:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788658402.726769:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658402.726787:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103757184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726817:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103757312:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726840:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658402.726865:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757312 00000100:00100000:3.0:1788658402.726868:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757312 00000100:00100000:3.0:1788658402.726891:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788658402.726897:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103757312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.726941:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103757312:12345-0@lo:400:kworker.0 Request processed in 43us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.726946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788658402.726960:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658402.726976:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103757312:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.727007:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103757440:0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.727034:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658402.727065:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757440 00000100:00100000:3.0:1788658402.727069:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757440 00000100:00100000:3.0:1788658402.727102:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658402.727115:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103757440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658402.727152:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103757440:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.727160:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788658402.727177:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788658402.727197:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56ff753100 x1875544103757440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658402.727207:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103757440:0@lo:400:kworker.0 00010000:00010000:1.0:1788658403.042203:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658403.234598:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658403.234626:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103757568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658403.234730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658403.235469:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757568 00000100:00100000:1.0:1788658403.235480:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757568 00000100:00100000:1.0:1788658403.235534:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658403.237012:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103757568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658403.238435:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658403.238528:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103757568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2984us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658403.238565:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788658403.240596:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700bb7b80 x1875544103757568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658403.240623:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103757568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788658404.066838:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658405.085916:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658406.109988:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658407.132916:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658407.324875:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658407.324903:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103757696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658407.325051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658407.325437:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757696 00000100:00100000:1.0:1788658407.325447:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757696 00000100:00100000:1.0:1788658407.325535:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658407.325546:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103757696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658407.325584:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658407.325639:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103757696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658407.325646:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788658407.325708:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c833b480 x1875544103757696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658407.325727:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103757696:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658407.325928:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658407.591028:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658407.591090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658407.591168:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461312 00000100:00100000:0.0:1788658407.591180:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461312 00000100:00100000:0.0:1788658407.591266:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:0.0:1788658407.591280:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076461312:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658407.591368:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076461312:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658407.591377:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00080000:1.0:1788658407.591447:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658407.591592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461184 00000100:00100000:3.0:1788658407.591598:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461184 00000100:00100000:3.0:1788658407.591704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 206 00000100:00100000:3.0:1788658407.591713:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076461184:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658407.591743:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2354:x1875544076461184:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 32us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658407.591749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 206 00000100:00100000:2.0:1788658407.838309:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fabd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103757952:0@lo:400:kworker.0 00000100:00100000:2.0:1788658407.838433:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658407.838499:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788658407.838505:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fabd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103757824:0@lo:400:kworker.0 00000100:00100000:2.0:1788658407.838535:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658407.838558:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fabd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103758336:0@lo:400:kworker.0 00000100:00100000:2.0:1788658407.838581:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658407.838611:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757824 00000100:00100000:2.0:1788658407.838620:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757824 00000100:00100000:2.0:1788658407.838690:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788658407.838701:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103757824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658407.838757:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103757824:12345-0@lo:400:kworker.0 Request processed in 58us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658407.838764:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788658407.838818:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fabd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103757824:0@lo:400:kworker.0 00000100:00100000:0.0:1788658407.839005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103757952 00000100:00100000:0.0:1788658407.839010:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103757952 00000100:00100000:0.0:1788658407.839039:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788658407.839046:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103757952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658407.839086:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103757952:12345-0@lo:400:kworker.0 Request processed in 41us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658407.839102:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658407.839187:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fabd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103757952:0@lo:400:kworker.0 00000100:00100000:1.0:1788658407.839261:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fabd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103758080:0@lo:400:kworker.0 00000100:00100000:1.0:1788658407.839307:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658407.839344:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658407.839351:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fabd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103758208:0@lo:400:kworker.0 00000100:00100000:1.0:1788658407.839375:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658407.839550:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758336 00000100:00100000:1.0:1788658407.839555:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758336 00000100:00100000:1.0:1788658407.839596:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658407.839604:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103758336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658407.839645:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103758336:12345-0@lo:400:kworker.0 Request processed in 43us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658407.839659:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788658407.839703:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788658407.839732:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56fabd0a80 x1875544103758336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658407.839744:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fabd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103758336:0@lo:400:kworker.0 00000100:00100000:0.0:1788658407.844759:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758080 00000100:00100000:0.0:1788658407.844775:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758080 00000100:00100000:0.0:1788658407.844855:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758208 00000100:00100000:0.0:1788658407.844859:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758208 00000100:00100000:0.0:1788658407.844895:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658407.844905:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103758080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658407.845002:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103758080:12345-0@lo:400:kworker.0 Request processed in 99us (5705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658407.845009:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658407.845026:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658407.845033:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103758208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658407.845063:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103758208:12345-0@lo:400:kworker.0 Request processed in 31us (5687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658407.845070:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788658407.845174:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658407.845226:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fabd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103758208:0@lo:400:kworker.0 00000100:00100000:1.0:1788658407.845242:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fabd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103758080:0@lo:400:kworker.0 00010000:00010000:1.0:1788658408.157827:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658408.349335:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103758464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658408.349415:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658408.349713:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758464 00000100:00100000:1.0:1788658408.349724:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758464 00000100:00100000:1.0:1788658408.349785:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788658408.349795:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103758464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658408.349833:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658408.354837:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103758464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5031us (5410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658408.354852:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788658408.357646:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c833b100 x1875544103758464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658408.357748:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103758464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788658409.180811:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658410.206263:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658411.228817:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658411.966974:0:10121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:33:30 (1788658410) === 00010000:00010000:1.0:1788658412.253061:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658412.448276:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658412.448311:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103758592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658412.448387:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658412.448746:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758592 00000100:00100000:2.0:1788658412.448761:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758592 00000100:00100000:2.0:1788658412.448854:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658412.448865:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103758592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658412.448912:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658412.448981:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103758592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658412.449002:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788658412.449012:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c8339180 x1875544103758592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658412.449036:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103758592:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788658412.449061:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658412.563424:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658412.564581:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461440 00000100:00100000:3.0:1788658412.564598:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461440 00000100:00100000:3.0:1788658412.564685:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 208 00000100:00100000:3.0:1788658412.564700:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:8147:x1875544076461440:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788658412.564720:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658412.564744:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dee00/0xf657f176650eab47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8acb4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658412.564794:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dee00/0xf657f176650eab47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acb4 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658412.564817:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dee00/0xf657f176650eab47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acb4 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658412.564827:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dee00, rc 0) 00000100:00100000:3.0:1788658412.564990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8147:x1875544076461440:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 293us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.564998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 208 00000100:00100000:2.0:1788658412.574297:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658412.574451:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461568 00000100:00100000:1.0:1788658412.574467:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461568 00000100:00100000:1.0:1788658412.574528:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:1.0:1788658412.574539:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8147:x1875544076461568:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658412.575081:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8147:x1875544076461568:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 539us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.575090:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:1.0:1788658412.578637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658412.578833:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461696 00000100:00100000:3.0:1788658412.578849:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461696 00000100:00100000:3.0:1788658412.578917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:3.0:1788658412.578931:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8147:x1875544076461696:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788658412.579262:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8147:x1875544076461696:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 333us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.579271:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:3.0:1788658412.584557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658412.584873:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461824 00000100:00100000:2.0:1788658412.584887:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461824 00000100:00100000:2.0:1788658412.584957:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:2.0:1788658412.584970:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8151:x1875544076461824:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658412.586056:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8151:x1875544076461824:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 1082us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658412.586067:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:2.0:1788658412.602540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658412.602769:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076461952 00000100:00100000:1.0:1788658412.602783:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076461952 00000100:00100000:1.0:1788658412.602859:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:1.0:1788658412.602871:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8151:x1875544076461952:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658412.603330:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8151:x1875544076461952:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 459us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.603341:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:1.0:1788658412.611736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658412.611978:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462080 00000100:00100000:2.0:1788658412.612005:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462080 00000100:00100000:2.0:1788658412.612067:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 213 00000100:00100000:2.0:1788658412.612078:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:8147:x1875544076462080:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658412.612094:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658412.612113:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd200/0xf657f176650eab4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8acde expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658412.612143:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd200/0xf657f176650eab4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acde expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658412.612155:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd200/0xf657f176650eab4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acde expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658412.612176:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd200, rc 0) 00000100:00100000:2.0:1788658412.612241:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:8147:x1875544076462080:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 165us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658412.612260:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 213 00000100:00100000:3.0:1788658412.615254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658412.615329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462208 00000100:00100000:1.0:1788658412.615344:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462208 00000100:00100000:1.0:1788658412.615620:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 214 00000100:00100000:1.0:1788658412.615634:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:8147:x1875544076462208:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788658412.615705:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788658412.615728:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788658412.615732:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788658412.615735:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788658412.615738:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788658412.619125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:8147:x1875544076462208:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 3483us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.619141:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 214 00000100:00100000:2.0:1788658412.621510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658412.621752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462336 00000100:00100000:3.0:1788658412.621764:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462336 00000100:00100000:3.0:1788658412.621960:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:3.0:1788658412.621970:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:8147:x1875544076462336:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788658412.621988:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658412.622008:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ace5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658412.622053:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658412.622064:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658412.622072:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dec00, rc 0) 00000100:00100000:3.0:1788658412.622137:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8147:x1875544076462336:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 169us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.622142:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:2.0:1788658412.624314:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658412.624392:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462464 00000100:00100000:1.0:1788658412.624401:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462464 00000100:00100000:1.0:1788658412.624484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:1.0:1788658412.624492:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8147:x1875544076462464:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658412.625016:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8147:x1875544076462464:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 522us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.625026:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:0.0:1788658412.626823:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658412.626954:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462592 00000100:00100000:3.0:1788658412.626965:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462592 00000100:00100000:0.0:1788658412.627129:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:0.0:1788658412.627140:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8147:x1875544076462592:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788658412.627363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8147:x1875544076462592:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 224us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658412.627373:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:2.0:1788658412.633456:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658412.633893:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462720 00000100:00100000:1.0:1788658412.633909:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462720 00000100:00100000:1.0:1788658412.633982:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 218 00000100:00100000:1.0:1788658412.633994:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8155:x1875544076462720:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658412.634303:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8155:x1875544076462720:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 308us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.634312:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 218 00000100:00100000:2.0:1788658412.643608:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658412.643902:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462848 00000100:00100000:0.0:1788658412.643916:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462848 00000100:00100000:0.0:1788658412.643990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:0.0:1788658412.644000:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8155:x1875544076462848:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658412.644298:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:8155:x1875544076462848:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 298us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658412.644308:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:0.0:1788658412.650127:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658412.650165:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658412.650292:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076463360 00000100:00100000:3.0:1788658412.650305:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076463360 00000100:00100000:3.0:1788658412.650385:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076462976 00000100:00100000:3.0:1788658412.650388:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076462976 00000100:00100000:3.0:1788658412.650407:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:3.0:1788658412.650418:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076463360:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658412.650642:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076463360:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 224us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.650650:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:3.0:1788658412.650906:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1788658412.650912:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1875544076462976:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788658412.650937:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5097b18f-92da-45ff-9ffe-4c6d955a08f5@192.168.202.3@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:3.0:1788658412.650976:0:6710:0:(genops.c:1385:class_connect()) connect: client 5097b18f-92da-45ff-9ffe-4c6d955a08f5, cookie 0xf657f176650eab5c 00000004:00100000:3.0:1788658412.651008:0:6710:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788658412.651329:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9e570051b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658412.651367:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2350:x1875544076462976:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 454us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.651375:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00080000:0.0:1788658412.651606:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658412.666263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658412.666313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658412.666398:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076463104 00000100:00100000:3.0:1788658412.666413:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076463104 00000100:00100000:3.0:1788658412.666499:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076463232 00000100:00100000:3.0:1788658412.666503:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076463232 00000100:00100000:3.0:1788658412.666530:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1788658412.666541:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+7:0:x1875544076463104:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658412.666611:0:6710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788658412.667095:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+7:0:x1875544076463104:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 553us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.667103:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1788658412.667125:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:3.0:1788658412.667133:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:8147:x1875544076463232:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658412.667146:0:6710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788658412.667169:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:8147:x1875544076463232:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 38us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.667174:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00080000:0.0:1788658412.667707:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658412.677513:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658412.678090:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076463488 00000100:00100000:3.0:1788658412.678173:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076463488 00000100:00100000:3.0:1788658412.678248:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1788658412.678262:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:8147:x1875544076463488:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788658412.678372:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:8147:x1875544076463488:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 113us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.678398:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:0.0:1788658412.688468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658412.688520:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658412.688550:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658412.688898:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076463872 00000100:00100000:1.0:1788658412.688911:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076463872 00000100:00100000:1.0:1788658412.688990:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:1.0:1788658412.689001:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:8147:x1875544076463872:12345-192.168.202.3@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788658412.689109:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788658412.689206:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:8147:x1875544076463872:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 205us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.689214:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:2.0:1788658412.689362:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076463616 00000100:00100000:2.0:1788658412.689367:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076463616 00000100:00100000:2.0:1788658412.689399:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076463744 00000100:00100000:2.0:1788658412.689402:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076463744 00000100:00100000:2.0:1788658412.689415:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1788658412.689420:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875544076463616:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658412.689443:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5097b18f-92da-45ff-9ffe-4c6d955a08f5@192.168.202.3@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:2.0:1788658412.689471:0:6687:0:(genops.c:1385:class_connect()) connect: client 5097b18f-92da-45ff-9ffe-4c6d955a08f5, cookie 0xf657f176650eab63 00002000:00100000:2.0:1788658412.689483:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5097b18f-92da-45ff-9ffe-4c6d955a08f5/ffff9e56d6ebb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658412.689494:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658412.689824:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788658412.689859:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9e56d6ebf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658412.689897:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2350:x1875544076463616:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 475us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658412.689904:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1788658412.689920:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:2.0:1788658412.689925:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875544076463744:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658412.689957:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5097b18f-92da-45ff-9ffe-4c6d955a08f5@192.168.202.3@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:2.0:1788658412.689972:0:6687:0:(genops.c:1385:class_connect()) connect: client 5097b18f-92da-45ff-9ffe-4c6d955a08f5, cookie 0xf657f176650eab6a 00002000:00100000:2.0:1788658412.689977:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5097b18f-92da-45ff-9ffe-4c6d955a08f5/ffff9e56d6eb9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658412.689995:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658412.690649:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788658412.690708:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9e56d6ebd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658412.690753:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2350:x1875544076463744:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 824us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658412.690762:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658412.957131:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103759104:0@lo:400:kworker.0 00000100:00100000:1.0:1788658412.957218:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658412.957305:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788658412.957312:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103758720:0@lo:400:kworker.0 00000100:00100000:1.0:1788658412.957344:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658412.957372:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103759232:0@lo:400:kworker.0 00000100:00100000:1.0:1788658412.957396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658412.957425:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103759232 00000100:00100000:1.0:1788658412.957434:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103759232 00000100:00100000:1.0:1788658412.957487:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788658412.957496:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103759232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658412.957547:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103759232:12345-0@lo:400:kworker.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.957554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788658412.957598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103759232:0@lo:400:kworker.0 00000100:00100000:0.0:1788658412.957822:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103758976:0@lo:400:kworker.0 00000100:00100000:0.0:1788658412.957852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658412.957880:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788658412.957885:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788658412.957913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658412.957925:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103759360:0@lo:400:kworker.0 00000100:00100000:0.0:1788658412.957952:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658412.957976:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103759104 00000100:00100000:0.0:1788658412.957980:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103759104 00000100:00100000:0.0:1788658412.958003:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103759360 00000100:00100000:0.0:1788658412.958005:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103759360 00000100:00100000:0.0:1788658412.958018:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658412.958024:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103759104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658412.958056:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103759104:12345-0@lo:400:kworker.0 Request processed in 32us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658412.958062:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658412.958074:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658412.958080:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658412.958111:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103759360:12345-0@lo:400:kworker.0 Request processed in 31us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658412.958118:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788658412.958133:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658412.958139:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788658412.958158:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834ce00 x1875544103759360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658412.958169:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103759360:0@lo:400:kworker.0 00010000:00080000:1.0:1788658412.958289:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56ff752d80 x1875544103759104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658412.958298:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103759104:0@lo:400:kworker.0 00000100:00100000:1.0:1788658412.958314:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758976 00000100:00100000:1.0:1788658412.958317:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758976 00000100:00100000:1.0:1788658412.958347:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758848 00000100:00100000:1.0:1788658412.958350:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758848 00000100:00100000:1.0:1788658412.958361:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658412.958366:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103758976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658412.958395:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103758976:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.958400:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658412.958409:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658412.958414:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103758848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658412.958434:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103758848:12345-0@lo:400:kworker.0 Request processed in 19us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658412.958449:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658412.960610:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103758720 00000100:00100000:3.0:1788658412.960626:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103758720 00000100:00100000:3.0:1788658412.960768:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788658412.960780:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103758720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658412.960877:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103758720:12345-0@lo:400:kworker.0 Request processed in 100us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658412.960884:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788658412.961034:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103758720:0@lo:400:kworker.0 00000100:00080000:0.0:1788658412.961696:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658412.961743:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788658412.961756:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103758976:0@lo:400:kworker.0 00010000:00010000:3.0:1788658413.277784:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658413.470899:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658413.470925:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103759488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658413.471027:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658413.471300:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103759488 00000100:00100000:0.0:1788658413.471312:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103759488 00000100:00100000:0.0:1788658413.471381:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788658413.471408:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103759488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658413.471442:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658413.471497:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103759488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658413.471505:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788658413.471554:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c833b480 x1875544103759488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658413.471576:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103759488:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788658413.531560:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5097b18f-92da-45ff-9ffe-4c6d955a08f5 00010000:00010000:1.0:1788658414.320882:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658415.325773:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658416.349079:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658416.593177:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5097b18f-92da-45ff-9ffe-4c6d955a08f5 00000001:00100000:0.0:1788658416.594228:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5097b18f-92da-45ff-9ffe-4c6d955a08f5 00010000:00010000:1.0:1788658417.375628:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658417.565334:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658417.565362:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103759616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658417.565455:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658417.565578:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103759616 00000100:00100000:2.0:1788658417.565587:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103759616 00000100:00100000:2.0:1788658417.565661:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658417.565690:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103759616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658417.565730:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658417.565786:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103759616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658417.565795:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788658417.565840:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c833a300 x1875544103759616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658417.565860:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103759616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788658417.566291:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658417.839865:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658417.839896:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658417.839916:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658417.839950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658417.839973:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658417.839997:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464000 00000100:00100000:0.0:1788658417.840009:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464000 00000100:00100000:0.0:1788658417.840063:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 221 00000100:00100000:0.0:1788658417.840076:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076464000:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658417.840156:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076464000:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658417.840164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 221 00000100:00100000:0.0:1788658417.840207:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464512 00000100:00100000:0.0:1788658417.840210:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464512 00000100:00100000:0.0:1788658417.840255:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464384 00000100:00100000:0.0:1788658417.840258:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464384 00000100:00100000:0.0:1788658417.840274:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658417.840280:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076464512:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658417.840306:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076464512:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658417.840312:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658417.840322:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1788658417.840327:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076464384:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658417.840346:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076464384:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 19us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658417.840351:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1788658417.840366:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464256 00000100:00100000:0.0:1788658417.840369:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464256 00000100:00100000:0.0:1788658417.840402:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464128 00000100:00100000:0.0:1788658417.840405:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464128 00000100:00100000:0.0:1788658417.840424:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:0.0:1788658417.840431:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076464256:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658417.840456:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076464256:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658417.840462:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:0.0:1788658417.840473:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:0.0:1788658417.840479:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076464128:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658417.840502:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076464128:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 23us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658417.840515:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00080000:0.0:1788658417.840660:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658417.840687:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788658417.840689:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658418.077872:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103760128:0@lo:400:kworker.0 00000100:00100000:3.0:1788658418.077957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658418.078036:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788658418.078042:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103759744:0@lo:400:kworker.0 00000100:00100000:3.0:1788658418.078074:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658418.078099:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103760256:0@lo:400:kworker.0 00000100:00100000:3.0:1788658418.078123:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658418.078153:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103759744 00000100:00100000:3.0:1788658418.078162:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103759744 00000100:00100000:3.0:1788658418.078263:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788658418.078273:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103759744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658418.078340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103759744:12345-0@lo:400:kworker.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658418.078347:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788658418.078400:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103759744:0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078479:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103759872:0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658418.078546:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103760384:0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658418.078587:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658418.078592:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103760000:0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078612:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658418.078640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760256 00000100:00100000:0.0:1788658418.078643:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760256 00000100:00100000:0.0:1788658418.078701:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103759872 00000100:00100000:0.0:1788658418.078705:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103759872 00000100:00100000:0.0:1788658418.078716:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760000 00000100:00100000:0.0:1788658418.078718:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760000 00000100:00100000:0.0:1788658418.078731:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658418.078737:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103760256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078772:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103760256:12345-0@lo:400:kworker.0 Request processed in 36us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.078778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658418.078792:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658418.078798:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078827:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103759872:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.078843:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658418.078856:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788658418.078861:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103760000:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788658418.078885:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658418.078888:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103760000:12345-0@lo:400:kworker.0 Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.078895:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788658418.078897:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760128 00000100:00100000:3.0:1788658418.078900:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760128 00000100:00100000:0.0:1788658418.078920:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103760000:0@lo:400:kworker.0 00000100:00100000:3.0:1788658418.078923:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760384 00000100:00100000:3.0:1788658418.078925:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760384 00000100:00100000:0.0:1788658418.078930:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103759872:0@lo:400:kworker.0 00000100:00100000:3.0:1788658418.078944:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658418.078950:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103760128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078951:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103760256:0@lo:400:kworker.0 00000100:00100000:0.0:1788658418.078986:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658418.078994:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103760128:12345-0@lo:400:kworker.0 Request processed in 44us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.078995:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788658418.079000:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658418.079010:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658418.079016:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103760384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658418.079046:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103760384:12345-0@lo:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658418.079052:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788658418.079064:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788658418.079081:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079ce00 x1875544103760384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658418.079091:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103760384:0@lo:400:kworker.0 00010000:00080000:3.0:1788658418.079111:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c833b480 x1875544103760128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658418.079118:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103760128:0@lo:400:kworker.0 00010000:00010000:1.0:1788658418.396922:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658418.589885:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658418.589916:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103760512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658418.589986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658418.590052:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760512 00000100:00100000:2.0:1788658418.590062:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760512 00000100:00100000:2.0:1788658418.590118:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658418.590128:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103760512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658418.590189:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658418.590238:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103760512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658418.590246:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788658418.590296:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079d500 x1875544103760512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658418.590317:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103760512:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788658418.637309:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788658419.424343:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658420.445056:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658421.468930:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658422.492932:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658422.684893:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103760640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658422.684976:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658422.685057:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760640 00000100:00100000:1.0:1788658422.685067:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760640 00000100:00100000:1.0:1788658422.685131:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658422.685141:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103760640:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788658422.685162:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788658422.685179:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658422.685242:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103760640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658422.685249:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788658422.685311:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079d500 x1875544103760640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658422.685332:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103760640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658422.950929:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658422.950972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658422.951004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658422.951025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658422.951050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658422.951080:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465024 00000100:00100000:0.0:1788658422.951099:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465024 00000100:00100000:0.0:1788658422.951163:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465152 00000100:00100000:0.0:1788658422.951166:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465152 00000100:00100000:0.0:1788658422.951189:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:0.0:1788658422.951199:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076465024:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658422.951275:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076465024:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658422.951283:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:0.0:1788658422.951302:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:0.0:1788658422.951309:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076465152:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658422.951336:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076465152:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658422.951342:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:0.0:1788658422.951361:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464640 00000100:00100000:0.0:1788658422.951364:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464640 00000100:00100000:0.0:1788658422.951388:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 223 00000100:00100000:0.0:1788658422.951394:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076464640:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658422.951415:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076464640:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658422.951421:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 223 00000100:00100000:0.0:1788658422.951450:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464768 00000100:00100000:0.0:1788658422.951454:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464768 00000100:00100000:0.0:1788658422.951480:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076464896 00000100:00100000:0.0:1788658422.951483:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076464896 00000100:00100000:0.0:1788658422.951503:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:0.0:1788658422.951510:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076464768:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658422.951545:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076464768:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 36us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658422.951552:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:0.0:1788658422.951562:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:0.0:1788658422.951568:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076464896:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658422.951585:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076464896:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 18us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658422.951591:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00080000:0.0:1788658422.951608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658422.951613:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658422.951615:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658423.207702:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103760768:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.207787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658423.207843:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103761280:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.207879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658423.207914:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658423.207920:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103761152:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.207963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658423.210110:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103760896:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.210194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658423.210241:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103761408:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.210270:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658423.210298:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658423.210306:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103761024:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.210330:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658423.210384:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760768 00000100:00100000:3.0:1788658423.211576:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760768 00000100:00100000:3.0:1788658423.211687:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788658423.211700:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103760768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.211786:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103760768:12345-0@lo:400:kworker.0 Request processed in 88us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658423.211794:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788658423.211840:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761280 00000100:00100000:3.0:1788658423.211847:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761280 00000100:00100000:3.0:1788658423.211883:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103760896 00000100:00100000:3.0:1788658423.211886:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103760896 00000100:00100000:3.0:1788658423.211899:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761024 00000100:00100000:3.0:1788658423.211903:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761024 00000100:00100000:3.0:1788658423.211920:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788658423.211940:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103761280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.211985:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103761280:12345-0@lo:400:kworker.0 Request processed in 59us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658423.213127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788658423.213141:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103760896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658423.213206:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103760896:12345-0@lo:400:kworker.0 Request processed in 71us (3012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658423.213214:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788658423.213232:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788658423.213240:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103761024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658423.213269:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103761024:12345-0@lo:400:kworker.0 Request processed in 31us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658423.213275:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788658423.213295:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761152 00000100:00100000:2.0:1788658423.213307:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761152 00000100:00100000:2.0:1788658423.213346:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761408 00000100:00100000:2.0:1788658423.213350:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761408 00000100:00100000:2.0:1788658423.213387:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658423.213520:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658423.213530:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103761408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658423.213570:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103761408:12345-0@lo:400:kworker.0 Request processed in 42us (3300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658423.213577:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658423.213871:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788658423.214063:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103760768:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.214087:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103761280:0@lo:400:kworker.0 00000100:00080000:3.0:1788658423.214123:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658423.214128:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658423.214151:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103761024:0@lo:400:kworker.0 00000100:00100000:3.0:1788658423.214162:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103760896:0@lo:400:kworker.0 00010000:00080000:3.0:1788658423.214176:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834dc00 x1875544103761408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658423.214186:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103761408:0@lo:400:kworker.0 00000100:00100000:2.0:1788658423.214531:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103761152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658423.214596:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103761152:12345-0@lo:400:kworker.0 Request processed in 1203us (6632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658423.214603:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788658423.215292:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834e300 x1875544103761152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658423.215308:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103761152:0@lo:400:kworker.0 00010000:00010000:1.0:1788658423.517264:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658423.709191:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658423.709219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103761536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658423.709305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658423.709470:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761536 00000100:00100000:1.0:1788658423.709480:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761536 00000100:00100000:1.0:1788658423.709532:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658423.709541:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103761536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658423.709605:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658423.709661:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103761536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658423.709685:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788658423.709762:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bce00 x1875544103761536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658423.709781:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103761536:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788658424.540989:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658425.565097:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658426.589440:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658427.613784:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658427.814443:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103761664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658427.814519:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658427.814599:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761664 00000100:00100000:3.0:1788658427.814609:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761664 00000100:00100000:3.0:1788658427.814702:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658427.814714:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103761664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658427.814753:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788658427.814802:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103761664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658427.814822:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788658427.814845:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658427.814893:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834e300 x1875544103761664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658427.814913:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103761664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658428.074656:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658428.074710:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658428.074736:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658428.074754:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658428.074774:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658428.074804:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465408 00000100:00100000:3.0:1788658428.074818:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465408 00000100:00100000:3.0:1788658428.074878:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465536 00000100:00100000:3.0:1788658428.074882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465536 00000100:00100000:3.0:1788658428.074906:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:3.0:1788658428.074917:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076465408:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658428.074990:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076465408:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658428.074998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:3.0:1788658428.075014:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:3.0:1788658428.075020:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076465536:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658428.075041:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076465536:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658428.075047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:3.0:1788658428.075062:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465664 00000100:00100000:3.0:1788658428.075091:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465664 00000100:00100000:3.0:1788658428.075118:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465792 00000100:00100000:3.0:1788658428.075120:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465792 00000100:00100000:3.0:1788658428.075138:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:3.0:1788658428.075144:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076465664:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658428.075168:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076465664:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658428.075174:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:3.0:1788658428.075183:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1788658428.075188:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076465792:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658428.075207:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076465792:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 19us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658428.075213:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1788658428.075229:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465280 00000100:00100000:3.0:1788658428.075232:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465280 00000100:00100000:3.0:1788658428.075253:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 225 00000100:00100000:3.0:1788658428.075258:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076465280:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658428.075280:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076465280:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658428.075286:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 225 00000100:00080000:3.0:1788658428.075317:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658428.075322:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658428.075325:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658428.317013:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103761792:0@lo:400:kworker.0 00000100:00100000:3.0:1788658428.317109:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658428.317503:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761792 00000100:00100000:1.0:1788658428.317514:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761792 00000100:00100000:1.0:1788658428.317572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788658428.317582:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103761792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.325495:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103762176:0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.325584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658428.325652:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658428.325658:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103762304:0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.325701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658428.325720:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762176 00000100:00100000:2.0:1788658428.325729:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103761920:0@lo:400:kworker.0 00000100:00100000:0.0:1788658428.325729:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762176 00000100:00100000:2.0:1788658428.325753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658428.325769:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103762432:0@lo:400:kworker.0 00000100:00100000:0.0:1788658428.325784:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658428.325788:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658428.325794:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103762176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.325803:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658428.325809:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103762048:0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.325828:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658428.325856:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762304 00000100:00100000:2.0:1788658428.325860:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762304 00000100:00100000:0.0:1788658428.325861:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103762176:12345-0@lo:400:kworker.0 Request processed in 68us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658428.325867:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658428.325884:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762432 00000100:00100000:0.0:1788658428.325887:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762432 00000100:00100000:2.0:1788658428.325891:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103761920 00000100:00100000:2.0:1788658428.325900:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103761920 00000100:00100000:0.0:1788658428.325908:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658428.325913:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762048 00000100:00100000:0.0:1788658428.325913:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103762432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.325915:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762048 00000100:00100000:2.0:1788658428.325927:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658428.325932:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103762304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658428.325949:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103762432:12345-0@lo:400:kworker.0 Request processed in 36us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658428.325955:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658428.325957:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103762304:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658428.325963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658428.325974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788658428.325979:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103761920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.326004:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103761920:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658428.326009:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788658428.326019:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658428.326024:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103762048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.326060:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103762048:12345-0@lo:400:kworker.0 Request processed in 24us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658428.326065:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658428.326118:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103762304:0@lo:400:kworker.0 00010000:00080000:2.0:1788658428.326131:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079f480 x1875544103762176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658428.326140:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103762176:0@lo:400:kworker.0 00000100:00080000:2.0:1788658428.326165:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658428.326170:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658428.326186:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103762048:0@lo:400:kworker.0 00000100:00100000:2.0:1788658428.326205:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103761920:0@lo:400:kworker.0 00010000:00080000:2.0:1788658428.326214:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e2300 x1875544103762432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658428.326222:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103762432:0@lo:400:kworker.0 00000100:00100000:1.0:1788658428.330179:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103761792:12345-0@lo:400:kworker.0 Request processed in 12587us (13058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658428.330197:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788658428.335007:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103761792:0@lo:400:kworker.0 00010000:00010000:1.0:1788658428.636864:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658428.831779:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103762560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658428.831859:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658428.832058:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762560 00000100:00100000:1.0:1788658428.832067:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762560 00000100:00100000:1.0:1788658428.832129:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658428.832139:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103762560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658428.832178:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658428.832229:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103762560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658428.832236:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788658428.832910:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bd180 x1875544103762560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658428.832935:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103762560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788658429.669057:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658430.684862:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658431.713443:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658432.732918:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658432.925684:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658432.925719:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103762688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658432.925792:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658432.925844:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762688 00000100:00100000:2.0:1788658432.925865:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762688 00000100:00100000:2.0:1788658432.925937:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658432.925948:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103762688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658432.926001:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658432.926054:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103762688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658432.926071:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788658432.926119:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834ca80 x1875544103762688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658432.926139:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103762688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658432.926425:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658433.192947:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658433.192987:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658433.193021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658433.193066:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466176 00000100:00100000:3.0:1788658433.193077:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466176 00000100:00100000:3.0:1788658433.193155:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466048 00000100:00100000:3.0:1788658433.193160:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466048 00000100:00100000:2.0:1788658433.193247:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:2.0:1788658433.193261:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076466176:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658433.193300:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076465920 00000100:00100000:1.0:1788658433.193304:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076465920 00000100:00100000:1.0:1788658433.193336:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 227 00000100:00100000:1.0:1788658433.193342:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076465920:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658433.193358:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076466176:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 101us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.193626:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076465920:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 282us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.193634:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 227 00000100:00100000:3.0:1788658433.193880:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:3.0:1788658433.193891:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076466048:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658433.193927:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076466048:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 40us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658433.193935:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00080000:3.0:1788658433.193954:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658433.193992:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658433.194369:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466304 00000100:00100000:1.0:1788658433.194376:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466304 00000100:00100000:1.0:1788658433.194423:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658433.194431:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2350:x1875544076466304:12345-192.168.202.3@tcp:9:kworker.0 00000100:00100000:3.0:1788658433.194617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000020:00000080:1.0:1788658433.194885:0:10289:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eab63 00000100:00080000:1.0:1788658433.194898:0:10289:0:(import.c:65:import_set_state_nolock()) ffff9e56d6ebf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658433.194944:0:10289:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788658433.195360:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+2:2350:x1875544076466304:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 926us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.195369:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658433.195562:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466432 00000100:00100000:1.0:1788658433.195569:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466432 00000100:00100000:1.0:1788658433.195621:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:1.0:1788658433.195631:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2350:x1875544076466432:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:1.0:1788658433.195649:0:10289:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eab6a 00000100:00080000:1.0:1788658433.195655:0:10289:0:(import.c:65:import_set_state_nolock()) ffff9e56d6ebd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658433.195711:0:10289:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788658433.195929:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+2:2350:x1875544076466432:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 299us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.195936:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00010000:00010000:1.0:1788658433.195965:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658433.195976:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658433.195984:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658433.195995:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658433.197705:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:2.0:1788658433.437002:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103763072:0@lo:400:kworker.0 00000100:00100000:2.0:1788658433.437087:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658433.437161:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658433.437167:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103762944:0@lo:400:kworker.0 00000100:00100000:2.0:1788658433.437189:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658433.437221:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763072 00000100:00100000:2.0:1788658433.437231:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763072 00000100:00100000:0.0:1788658433.437436:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103763200:0@lo:400:kworker.0 00000100:00100000:0.0:1788658433.437465:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658433.437537:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788658433.437544:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103762816:0@lo:400:kworker.0 00000100:00100000:0.0:1788658433.437576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658433.437594:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103763328:0@lo:400:kworker.0 00000100:00100000:0.0:1788658433.437616:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658433.437653:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763328 00000100:00100000:0.0:1788658433.437657:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763328 00000100:00100000:0.0:1788658433.437711:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658433.437721:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103763328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658433.437775:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103763328:12345-0@lo:400:kworker.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658433.437783:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788658433.437828:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e1180 x1875544103763328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658433.437844:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103763328:0@lo:400:kworker.0 00000100:00100000:1.0:1788658433.438046:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762944 00000100:00100000:1.0:1788658433.438051:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762944 00000100:00100000:1.0:1788658433.438087:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763200 00000100:00100000:1.0:1788658433.438091:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763200 00000100:00100000:1.0:1788658433.438107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788658433.438113:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103762944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658433.438154:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103762944:12345-0@lo:400:kworker.0 Request processed in 41us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.438160:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788658433.438172:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788658433.438178:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103763200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658433.438205:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103763200:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.438211:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788658433.438229:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103762816 00000100:00100000:1.0:1788658433.438233:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103762816 00000100:00100000:1.0:1788658433.438254:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788658433.438260:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103762816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658433.438299:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103762816:12345-0@lo:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.438305:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788658433.438448:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788658433.438457:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103763072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658433.438499:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103763072:12345-0@lo:400:kworker.0 Request processed in 44us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658433.438506:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788658433.438588:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658433.438593:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658433.438617:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103762944:0@lo:400:kworker.0 00000100:00100000:2.0:1788658433.438628:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103763072:0@lo:400:kworker.0 00000100:00100000:0.0:1788658433.440323:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103762816:0@lo:400:kworker.0 00000100:00100000:0.0:1788658433.440344:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103763200:0@lo:400:kworker.0 00010000:00010000:2.0:1788658433.757062:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658433.949284:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103763456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658433.949374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658433.949609:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763456 00000100:00100000:1.0:1788658433.949619:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763456 00000100:00100000:1.0:1788658433.949695:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658433.949704:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103763456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658433.949741:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658433.949792:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103763456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.949798:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788658433.951908:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bfb80 x1875544103763456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658433.951935:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103763456:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788658434.071182:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5097b18f-92da-45ff-9ffe-4c6d955a08f5 00000020:00000080:1.0:1788658434.071191:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e56d6ebb000/5097b18f-92da-45ff-9ffe-4c6d955a08f5 00000020:00000080:0.0:1788658434.071248:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d6ebb000/5097b18f-92da-45ff-9ffe-4c6d955a08f5 for lustre-OST0000 00000020:00000080:0.0:1788658434.071297:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56d6ebf800 for lustre-OST0000 00010000:00010000:1.0:1788658434.780861:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658435.808965:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788658435.931338:0:11019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788658436.828976:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658437.108572:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5097b18f-92da-45ff-9ffe-4c6d955a08f5 00000020:00000080:3.0:1788658437.108582:0:7647:0:(genops.c:885:class_export_put()) final put ffff9e56d6eb9000/5097b18f-92da-45ff-9ffe-4c6d955a08f5 00000020:00000080:1.0:1788658437.108692:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d6eb9000/5097b18f-92da-45ff-9ffe-4c6d955a08f5 for lustre-OST0001 00000020:00000080:1.0:1788658437.108746:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56d6ebd800 for lustre-OST0001 00010000:00010000:1.0:1788658437.853815:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658438.047163:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658438.047227:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103763584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658438.047306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658438.047490:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763584 00000100:00100000:1.0:1788658438.047500:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763584 00000100:00100000:1.0:1788658438.047567:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658438.047577:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103763584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658438.047610:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658438.047661:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103763584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658438.047688:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788658438.047731:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e1f80 x1875544103763584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658438.047751:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103763584:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788658438.048091:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658438.321726:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658438.321760:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658438.321783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658438.321823:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466560 00000100:00100000:3.0:1788658438.321836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466560 00000100:00100000:3.0:1788658438.321894:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 229 00000100:00100000:3.0:1788658438.321906:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076466560:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658438.322355:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466688 00000100:00100000:2.0:1788658438.322370:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466688 00000100:00100000:2.0:1788658438.322415:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466816 00000100:00100000:2.0:1788658438.322418:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466816 00000100:00100000:2.0:1788658438.322439:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:2.0:1788658438.322445:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076466688:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658438.322513:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076466688:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 67us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658438.322521:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:2.0:1788658438.322538:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:2.0:1788658438.322543:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076466816:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658438.322564:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076466816:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 21us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658438.322570:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00080000:2.0:1788658438.322587:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658438.323422:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076466560:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1515us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658438.323433:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 229 00000100:00100000:3.0:1788658438.567492:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103763840:0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.567568:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658438.567640:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788658438.567646:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103763712:0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.567810:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658438.567835:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103764224:0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.567865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658438.567892:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103763968:0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.567926:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658438.567945:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658438.567950:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103764096:0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.567970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658438.567999:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763840 00000100:00100000:3.0:1788658438.568009:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763840 00000100:00100000:3.0:1788658438.568056:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763968 00000100:00100000:3.0:1788658438.568059:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763968 00000100:00100000:3.0:1788658438.568081:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103764096 00000100:00100000:3.0:1788658438.568084:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103764096 00000100:00100000:3.0:1788658438.568101:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658438.568110:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103763840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.568165:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103763840:12345-0@lo:400:kworker.0 Request processed in 55us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658438.568173:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658438.568204:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788658438.568209:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103763968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.568929:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103763968:12345-0@lo:400:kworker.0 Request processed in 718us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658438.568938:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788658438.568956:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788658438.568963:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103764096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.568990:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103764096:12345-0@lo:400:kworker.0 Request processed in 28us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658438.568995:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788658438.569014:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103763712 00000100:00100000:3.0:1788658438.569019:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103763712 00000100:00100000:3.0:1788658438.569044:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788658438.569050:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103763712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.569079:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103763712:12345-0@lo:400:kworker.0 Request processed in 28us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658438.569085:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788658438.569113:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103764224 00000100:00100000:3.0:1788658438.569117:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103764224 00000100:00100000:3.0:1788658438.569143:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658438.569150:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103764224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658438.569180:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103764224:12345-0@lo:400:kworker.0 Request processed in 31us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658438.569186:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788658438.569209:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658438.569657:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103763712:0@lo:400:kworker.0 00010000:00080000:2.0:1788658438.570009:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834ce00 x1875544103764224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658438.570022:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103764224:0@lo:400:kworker.0 00000100:00100000:2.0:1788658438.570035:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103763840:0@lo:400:kworker.0 00000100:00100000:0.0:1788658438.570171:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103764096:0@lo:400:kworker.0 00000100:00100000:0.0:1788658438.570183:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103763968:0@lo:400:kworker.0 00000100:00080000:3.0:1788658438.571192:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788658438.876863:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658439.079413:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658439.079439:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103764352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658439.079512:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658439.079588:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103764352 00000100:00100000:1.0:1788658439.079600:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103764352 00000100:00100000:1.0:1788658439.079831:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788658439.079842:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103764352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658439.079904:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658439.079963:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103764352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658439.079971:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788658439.080021:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014be300 x1875544103764352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658439.080116:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103764352:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788658439.124996:0:11167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe087a01b0 20000000:00000080:2.0:1788658439.125014:0:11167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e56c8838800 uarg=0000000000000000 20000000:01000000:2.0:1788658439.125052:0:11167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788658439.125059:0:11167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788658439.125065:0:11167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788658439.126169:0:11168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788658439.126374:0:11167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788658439.132352:0:11167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788658439.132385:0:11167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.132409:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.132418:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab1d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.132425:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab2b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.132432:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab39 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.132438:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.132446:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133070:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133087:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 12 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658439.133105:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103764480:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658439.133283:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eab39 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133312:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eab39 expref: 18 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658439.133322:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103764608:0@lo:104: 00000100:00100000:2.0:1788658439.133365:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658439.133411:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eab2b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133420:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eab2b expref: 18 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658439.133427:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103764736:0@lo:104: 00000100:00100000:2.0:1788658439.133447:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658439.133483:0:8509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103764608 00000100:00100000:2.0:1788658439.133491:0:8509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103764608 00000100:00100000:2.0:1788658439.133536:0:8509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103764736 00000100:00100000:2.0:1788658439.133538:0:8509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103764736 00000100:00100000:2.0:1788658439.133554:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658439.133562:0:8509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88ab4306-42c5-43ae-b202-256d86278024+4:11167:x1875544103764608:12345-0@lo:104: 00010000:00010000:2.0:1788658439.133576:0:8509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133626:0:8509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658439.133632:0:8509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88ab4306-42c5-43ae-b202-256d86278024+4:11167:x1875544103764608:12345-0@lo:104: Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658439.133639:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658439.133658:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658439.133695:0:8509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88ab4306-42c5-43ae-b202-256d86278024+3:11167:x1875544103764736:12345-0@lo:104: 00010000:00010000:2.0:1788658439.133708:0:8509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133742:0:8509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788658439.133747:0:8509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88ab4306-42c5-43ae-b202-256d86278024+3:11167:x1875544103764736:12345-0@lo:104: Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658439.133754:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788658439.133771:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658439.133778:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133784:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658439.133788:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133797:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658439.133805:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658439.133810:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658439.133839:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133857:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658439.133874:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133881:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac78c00/0xf657f176650eab39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133900:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658439.133903:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133909:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658439.133912:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133919:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658439.133925:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658439.133931:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658439.133946:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133951:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658439.133957:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133963:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac78800/0xf657f176650eab2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.133972:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658439.133974:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658439.133976:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658439.134010:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eab1d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.134026:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eab1d expref: 18 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658439.134035:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103765120:0@lo:104: 00000100:00100000:2.0:1788658439.134061:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658439.134080:0:8509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103765120 00000100:00100000:2.0:1788658439.134084:0:8509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103765120 00000100:00100000:2.0:1788658439.134100:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658439.134106:0:8509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88ab4306-42c5-43ae-b202-256d86278024+3:11167:x1875544103765120:12345-0@lo:104: 00010000:00010000:2.0:1788658439.134114:0:8509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.134147:0:8509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788658439.134627:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658439.134633:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.134640:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658439.134643:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.134650:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658439.134657:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658439.134677:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658439.134710:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.134723:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658439.134741:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.134748:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac78000/0xf657f176650eab1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.134765:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658439.134767:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658439.134768:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658439.134783:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103764864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658439.134820:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658439.134858:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658439.134864:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103764992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658439.134886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658439.134914:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103765248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658439.134934:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658439.134964:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103764864 00000100:00100000:0.0:1788658439.134968:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103764864 00010000:00010000:0.0:1788658439.134989:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab39 expref: 19 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.135011:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103764992 00000100:00100000:0.0:1788658439.135013:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103764992 00010000:00010000:0.0:1788658439.135024:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab2b expref: 20 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.135034:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103765248 00000100:00100000:0.0:1788658439.135043:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103765248 00010000:00010000:0.0:1788658439.135056:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab1d expref: 21 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.135069:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658439.135084:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8937050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+21:3306:x1875544103764864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658439.135096:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658439.135101:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab39 expref: 21 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.135111:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eab39 expref: 21 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.135128:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658439.135238:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8937050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+21:3306:x1875544103764864:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658439.135245:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658439.135290:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658439.135297:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+20:3306:x1875544103764992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658439.135304:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658439.135308:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab2b expref: 20 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.135316:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eab2b expref: 20 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.135326:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658439.135345:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+20:3306:x1875544103764992:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658439.135351:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658439.135372:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658439.135377:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103765248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658439.135384:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658439.135388:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab1d expref: 19 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.135396:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eab1d expref: 19 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.135405:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658439.135430:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103765248:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658439.135436:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658439.135483:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103765248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658439.135508:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103764992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658439.135516:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103764864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658439.136366:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.136379:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 12 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.136392:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103765376:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658439.136455:0:11167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca240 going to sleep for 11 seconds 00010000:00010000:0.0:1788658439.136473:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cc800/0xf657f176650eab40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eab39 expref: 18 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.136496:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103764608:0@lo:104: 00010000:00010000:0.0:1788658439.136510:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79000/0xf657f176650eab32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eab2b expref: 17 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.136518:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103764736:0@lo:104: 00010000:00010000:0.0:1788658439.136526:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eab24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eab1d expref: 16 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.136533:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103765120:0@lo:104: 00010000:00010000:3.0:1788658439.137690:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658439.138581:0:8509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88ab4306-42c5-43ae-b202-256d86278024+3:11167:x1875544103765120:12345-0@lo:104: Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658439.138595:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658439.140711:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103764480:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658439.140727:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875544103765376:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658439.140766:0:11167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658439.141607:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658439.141892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658439.142028:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076466944 00000100:00100000:3.0:1788658439.142037:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076466944 00010000:00010000:3.0:1788658439.142079:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 13 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658439.142118:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467072 00000100:00100000:1.0:1788658439.142123:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467072 00010000:00010000:1.0:1788658439.142140:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 14 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658439.142180:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1788658439.142190:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+14:2351:x1875544076466944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658439.142207:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658439.142212:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 14 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658439.142223:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 14 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658439.142241:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29df600/0xf657f176650eab16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acad expref: 14 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658439.142255:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658439.142370:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:0.0:1788658439.142380:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076467072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658439.142388:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658439.142392:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 13 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142402:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 13 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142411:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dec00/0xf657f176650eab55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ace5 expref: 13 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142430:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142438:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142452:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142459:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142467:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142473:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142479:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cda00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658439.142484:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142493:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142508:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.142518:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658439.142556:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:2351:x1875544076466944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 367us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658439.142564:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:0.0:1788658439.142897:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:2351:x1875544076467072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 518us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658439.142910:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00010000:00010000:0.0:1788658439.144150:0:11167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.144231:0:11167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658439.144238:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cda00/0xf657f176650eab71 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658439.903269:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658440.169120:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658440.169281:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467200 00000100:00100000:3.0:1788658440.169294:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467200 00000100:00100000:3.0:1788658440.169357:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 231 00000100:00100000:3.0:1788658440.169368:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:5592:x1875544076467200:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658440.169386:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658440.169406:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad0f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.169435:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.169447:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.169457:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:3.0:1788658440.170613:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076467200:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 1242us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.170627:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 231 00000100:00100000:2.0:1788658440.188981:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658440.189028:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467328 00000100:00100000:2.0:1788658440.189051:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467328 00000100:00100000:2.0:1788658440.189110:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 232 00000100:00100000:2.0:1788658440.189121:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076467328:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658440.189417:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076467328:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 297us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658440.189426:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 232 00000100:00100000:0.0:1788658440.203020:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658440.203210:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467456 00000100:00100000:3.0:1788658440.203225:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467456 00000100:00100000:3.0:1788658440.203296:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:3.0:1788658440.203308:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076467456:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.204677:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076467456:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 1351us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.204700:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:3.0:1788658440.217931:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658440.218381:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467584 00000100:00100000:1.0:1788658440.218394:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467584 00000100:00100000:1.0:1788658440.218456:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 234 00000100:00100000:1.0:1788658440.218468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076467584:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658440.218487:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658440.218517:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658440.218553:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658440.218564:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658440.218573:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679c00, rc 0) 00000100:00100000:1.0:1788658440.218643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076467584:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 177us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658440.218650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 234 00000100:00100000:2.0:1788658440.237929:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658440.247395:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467712 00000100:00100000:0.0:1788658440.247412:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467712 00000100:00100000:0.0:1788658440.247486:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 235 00000100:00100000:0.0:1788658440.247506:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076467712:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658440.247858:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076467712:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 362us (9939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.247868:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 235 00000100:00100000:3.0:1788658440.251064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658440.251101:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467840 00000100:00100000:3.0:1788658440.251114:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467840 00000100:00100000:3.0:1788658440.251171:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 236 00000100:00100000:3.0:1788658440.251182:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076467840:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.251404:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076467840:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 224us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.251412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 236 10000000:01000000:2.0:1788658440.551732:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658440.551738:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56fef6c800 from 7 10000000:01000000:2.0:1788658440.551742:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658440.551808:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.551821:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.551833:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658440.551863:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658440.551939:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658440.552010:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c652c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658440.553092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103765504 00000100:00100000:1.0:1788658440.553104:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103765504 00000100:00100000:1.0:1788658440.553263:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788658440.553275:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103765504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658440.553293:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658440.553364:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eab86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658440.553410:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eab86 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658440.553422:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab86 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658440.553431:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679600, rc 0) 00000100:00100000:1.0:1788658440.553731:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103765504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 457us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658440.553739:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788658440.558435:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658440.558468:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.558480:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658440.558568:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.558630:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.558711:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658440.561959:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103765632 00000100:00100000:2.0:1788658440.561976:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103765632 00000100:00100000:2.0:1788658440.562057:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788658440.562068:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103765632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658440.562373:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103765632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (3742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658440.562382:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788658440.562654:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.562746:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.562793:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.562831:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658440.562893:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103765760 00000100:00100000:2.0:1788658440.562898:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103765760 00000100:00100000:2.0:1788658440.562930:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788658440.562938:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103765760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658440.563091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103765760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658440.563107:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788658440.563229:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788658440.566795:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788658440.566950:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788658440.566969:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658440.566981:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.567003:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658440.567013:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658440.567016:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e57014ee800 from 7 10000000:01000000:2.0:1788658440.567019:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658440.567060:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.567069:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.567080:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658440.567110:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658440.567182:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658440.567229:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c67dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658440.567446:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103765888 00000100:00100000:3.0:1788658440.567454:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103765888 00000100:00100000:3.0:1788658440.567506:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788658440.567517:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103765888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658440.567531:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658440.567545:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eab94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.567568:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eab94 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.567579:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab94 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.567588:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658440.567634:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103765888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.567642:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788658440.567724:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103765888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658440.567739:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.567749:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658440.567802:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.567838:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.567860:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766016 00000100:00100000:3.0:1788658440.567864:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766016 00000100:00100000:3.0:1788658440.567885:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788658440.567891:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103766016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.568504:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103766016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 611us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.568511:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788658440.568540:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658440.568552:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.568585:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.568623:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.570472:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658440.580544:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766144 00000100:00100000:0.0:1788658440.580559:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766144 00000100:00100000:0.0:1788658440.580629:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788658440.580641:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103766144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658440.580912:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103766144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (12287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.580921:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788658440.581766:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c8338a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658440.590628:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788658440.594218:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788658440.594257:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658440.594269:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.594282:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658440.594294:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658440.594296:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56f44c2000 from 7 10000000:01000000:3.0:1788658440.594299:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658440.594343:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.594352:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.594372:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658440.594405:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.594477:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.594528:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658440.594589:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766272 00000100:00100000:2.0:1788658440.594600:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766272 00000100:00100000:2.0:1788658440.594652:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788658440.594677:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103766272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658440.594710:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658440.594724:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eaba2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.594748:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eaba2 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.594759:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaba2 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658440.594768:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd400, rc 0) 00000100:00100000:2.0:1788658440.594817:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103766272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658440.594823:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788658440.594937:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658440.594954:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658440.594963:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658440.595023:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.595047:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.595072:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658440.595084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766400 00000100:00100000:2.0:1788658440.595088:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766400 00000100:00100000:2.0:1788658440.595118:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788658440.595125:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103766400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658440.595376:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103766400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658440.595384:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788658440.595406:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.595435:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658440.595470:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.595494:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658440.595604:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766528 00000100:00100000:2.0:1788658440.595609:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766528 00000100:00100000:2.0:1788658440.595637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788658440.595643:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103766528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658440.595813:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103766528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658440.595828:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788658440.595945:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c833a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103766528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658440.596757:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788658440.597200:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788658440.597222:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658440.597234:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658440.597245:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658440.924875:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658441.952378:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658442.972831:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658443.166171:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103766656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658443.166296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658443.166409:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766656 00000100:00100000:0.0:1788658443.166418:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766656 00000100:00100000:0.0:1788658443.166481:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788658443.166490:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103766656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658443.166524:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658443.166578:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103766656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658443.166585:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788658443.166627:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57004fb100 x1875544103766656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658443.166647:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103766656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658443.166797:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658443.439059:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658443.439099:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658443.439136:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658443.439165:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076468224 00000100:00100000:3.0:1788658443.439181:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076468224 00000100:00100000:3.0:1788658443.439236:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076468096 00000100:00100000:3.0:1788658443.439239:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076468096 00000100:00100000:3.0:1788658443.439259:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:3.0:1788658443.439269:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076468224:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658443.439348:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076468224:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658443.439355:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:3.0:1788658443.439371:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:3.0:1788658443.439376:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076468096:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658443.439393:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076468096:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 17us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658443.439399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00080000:3.0:1788658443.439412:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658443.440103:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076467968 00000100:00100000:0.0:1788658443.440111:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076467968 00000100:00100000:0.0:1788658443.440153:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 246 00000100:00100000:0.0:1788658443.440162:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076467968:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658443.440215:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076467968:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 53us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658443.440223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 246 00000100:00100000:1.0:1788658443.676951:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103766912:0@lo:400:kworker.0 00000100:00100000:3.0:1788658443.677130:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103766784:0@lo:400:kworker.0 00000100:00100000:3.0:1788658443.677170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658443.677225:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103767296:0@lo:400:kworker.0 00000100:00100000:3.0:1788658443.677264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658443.677312:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766784 00000100:00100000:3.0:1788658443.677322:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766784 00000100:00100000:3.0:1788658443.677371:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788658443.677381:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103766784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658443.677438:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103766784:12345-0@lo:400:kworker.0 Request processed in 57us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658443.677445:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788658443.677493:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767296 00000100:00100000:3.0:1788658443.677503:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767296 00000100:00100000:3.0:1788658443.677540:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658443.677546:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103767296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658443.677577:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103767296:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658443.677582:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788658443.677599:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658443.677632:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103766784:0@lo:400:kworker.0 00010000:00080000:3.0:1788658443.677648:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bce00 x1875544103767296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658443.677659:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103767296:0@lo:400:kworker.0 00000100:00100000:1.0:1788658443.677996:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658443.678738:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103767168:0@lo:400:kworker.0 00000100:00100000:2.0:1788658443.678798:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103767040:0@lo:400:kworker.0 00000100:00100000:1.0:1788658443.685361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658443.685456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658443.685493:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103766912 00000100:00100000:0.0:1788658443.685505:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103766912 00000100:00100000:1.0:1788658443.685542:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767168 00000100:00100000:1.0:1788658443.685546:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767168 00000100:00100000:0.0:1788658443.685565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767040 00000100:00100000:1.0:1788658443.685580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788658443.685580:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767040 00000100:00100000:1.0:1788658443.685590:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103766912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658443.685597:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658443.685602:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103767168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658443.685689:0:6710:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788658443.685699:0:6710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788658443.686227:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788658443.686240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788658443.686248:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103767040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658443.690463:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103767168:12345-0@lo:400:kworker.0 Request processed in 4850us (5100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658443.690490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658443.692061:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103767168:0@lo:400:kworker.0 00000100:00100000:1.0:1788658443.695027:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103766912:12345-0@lo:400:kworker.0 Request processed in 9431us (17988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658443.695055:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788658443.696032:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103766912:0@lo:400:kworker.0 00000001:02000400:2.0:1788658443.699102:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788658443.702427:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103767040:12345-0@lo:400:kworker.0 Request processed in 16170us (16961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658443.702443:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788658443.702481:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103767040:0@lo:400:kworker.0 00000100:00080000:3.0:1788658443.702502:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788658443.999096:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658444.190445:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103767424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658444.190530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658444.190746:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767424 00000100:00100000:2.0:1788658444.190756:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767424 00000100:00100000:2.0:1788658444.190815:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788658444.190825:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103767424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658444.190869:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658444.190921:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103767424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658444.190929:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788658444.191312:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e1500 x1875544103767424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658444.191334:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103767424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788658445.021009:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658446.048479:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658447.069159:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658448.045169:0:11468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:34:05 (1788658445) === 00010000:00010000:3.0:1788658448.109293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658448.296835:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658448.296858:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103767552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658448.296925:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658448.297063:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767552 00000100:00100000:1.0:1788658448.297071:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767552 00000100:00100000:1.0:1788658448.297137:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658448.297148:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103767552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658448.297182:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658448.297230:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103767552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658448.297237:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788658448.297281:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658448.297309:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56de9f9c00 x1875544103767552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658448.297326:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103767552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658448.360464:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.360516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.360550:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076468352 00000100:00100000:0.0:1788658448.360558:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076468352 00000100:00100000:0.0:1788658448.360619:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:0.0:1788658448.360630:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076468352:12345-192.168.202.3@tcp:41:mkdir.0 00000004:00000024:0.0:1788658448.360694:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788658448.360780:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076468352:12345-192.168.202.3@tcp:41:mkdir.0 Request processed in 151us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658448.360787:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00080000:0.0:1788658448.360810:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658448.361744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076468480 00000100:00100000:2.0:1788658448.361755:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076468480 00000100:00100000:2.0:1788658448.361800:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1788658448.361810:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:9704:x1875544076468480:12345-192.168.202.3@tcp:700:mkdir.0 00000100:00100000:2.0:1788658448.361871:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:9704:x1875544076468480:12345-192.168.202.3@tcp:700:mkdir.0 Request processed in 62us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.361878:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658448.378585:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.378622:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076468736 00000100:00100000:0.0:1788658448.378631:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076468736 00000100:00100000:0.0:1788658448.378716:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:0.0:1788658448.378727:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:9704:x1875544076468736:12345-192.168.202.3@tcp:36:mkdir.0 00010000:00010000:0.0:1788658448.378818:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658448.378865:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eaa91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac98 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.378884:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59700) 00010000:00010000:0.0:1788658448.378895:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658448.379208:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.379222:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.379231:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.379258:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.379265:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.379272:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658448.383183:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788658448.383213:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.383226:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.383242:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.383248:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658448.383254:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.383263:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.383278:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:0.0:1788658448.383281:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658448.383286:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.383292:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabb0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658448.383311:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e698ef8c reply state 00000000ec721bf1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658448.383319:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658448.385025:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:9704:x1875544076468736:12345-192.168.202.3@tcp:36:mkdir.0 Request processed in 6288us (6437us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788658448.385038:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00010000:00010000:3.0:1788658448.409728:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.409745:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.409752:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.409758:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.409762:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.409770:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.409791:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e56c3c69a00) 00010000:00010000:3.0:1788658448.409794:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658448.409800:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.409806:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eabb7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658448.413021:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.413421:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076468864 00000100:00100000:3.0:1788658448.413432:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076468864 00000100:00100000:3.0:1788658448.413493:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1788658448.413513:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:9705:x1875544076468864:12345-192.168.202.3@tcp:101:chmod.0 00010000:00010000:3.0:1788658448.413535:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658448.413560:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eabbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad1d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.413628:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eabc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.413642:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eabc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.413654:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eabc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658448.413728:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788658448.413732:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658448.413773:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eabc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.413810:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eabbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad1d expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.413828:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eabc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad1d expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.413836:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d0810c00) 00010000:00010000:3.0:1788658448.413852:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658448.413857:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efc00, rc 0) 00000100:00100000:3.0:1788658448.413924:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:9705:x1875544076468864:12345-192.168.202.3@tcp:101:chmod.0 Request processed in 422us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658448.413941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1788658448.419451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.419701:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076469120 00000100:00100000:0.0:1788658448.419780:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076469120 00000100:00100000:0.0:1788658448.419907:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1788658448.419918:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:9705:x1875544076469120:12345-192.168.202.3@tcp:36:chmod.0 00010000:00010000:0.0:1788658448.420014:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658448.420313:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eabc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad1d expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.420332:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d0810c00) 00010000:00010000:0.0:1788658448.420346:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658448.420458:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.420472:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.420483:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658448.421207:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061e55a62 reply state 000000004a264810 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658448.421219:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788658448.421227:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788658448.421997:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:9705:x1875544076469120:12345-192.168.202.3@tcp:36:chmod.0 Request processed in 2077us (2551us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788658448.422006:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00010000:00010000:3.0:1788658448.429028:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.429045:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.429053:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.429058:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.429062:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.429070:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.429087:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:3.0:1788658448.429090:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658448.429095:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.429101:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eabcc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658448.454434:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.454595:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076469248 00000100:00100000:0.0:1788658448.454606:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076469248 00000100:00100000:0.0:1788658448.454716:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1788658448.454727:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:9706:x1875544076469248:12345-192.168.202.3@tcp:101:chown.0 00010000:00010000:0.0:1788658448.454750:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658448.454775:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eabd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad24 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.454856:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eabda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.454873:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eabda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.454886:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eabda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658448.455858:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658448.455866:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658448.455911:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eabda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.455955:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eabd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad24 expref: 9 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.455974:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eabda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad24 expref: 8 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.455982:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:1.0:1788658448.455985:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658448.455988:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78e00, rc 0) 00000100:00100000:1.0:1788658448.456103:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:9706:x1875544076469248:12345-192.168.202.3@tcp:101:chown.0 Request processed in 1377us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658448.456119:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1788658448.463312:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658448.464216:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076469376 00000100:00100000:2.0:1788658448.464238:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076469376 00000100:00100000:2.0:1788658448.464302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:2.0:1788658448.464312:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:9706:x1875544076469376:12345-192.168.202.3@tcp:101:chown.0 00010000:00010000:2.0:1788658448.464332:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658448.464357:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eabe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad2b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464421:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464436:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464449:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464464:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464470:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464476:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464563:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eabf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464571:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eabf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464578:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eabf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658448.464616:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658448.464619:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658448.464641:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eabf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464652:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464658:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464709:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464715:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3ccc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658448.464718:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464726:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464737:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:2.0:1788658448.464739:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658448.464743:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464749:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eabe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464761:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464776:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464781:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464785:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658448.464788:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464794:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464801:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e56d579c000) 00010000:00010000:2.0:1788658448.464803:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658448.464805:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464810:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eabef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464841:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eabe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad2b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464853:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eabf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad2b expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.464859:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:2.0:1788658448.464862:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658448.464872:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc000, rc 0) 00000100:00100000:2.0:1788658448.465202:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:9706:x1875544076469376:12345-192.168.202.3@tcp:101:chown.0 Request processed in 890us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.465210:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1788658448.470427:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.470876:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076469632 00000100:00100000:0.0:1788658448.470887:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076469632 00000100:00100000:0.0:1788658448.471028:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1788658448.471039:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:9706:x1875544076469632:12345-192.168.202.3@tcp:36:chown.0 00010000:00010000:0.0:1788658448.471089:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658448.471112:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eabf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad2b expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.471132:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:0.0:1788658448.471142:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658448.471166:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.471177:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.471187:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658448.512865:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788658448.513034:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d716b070 reply state 00000000e74591ab transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658448.513048:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788658448.513062:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788658448.513172:0:6710:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788658448.514037:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:9706:x1875544076469632:12345-192.168.202.3@tcp:36:chown.0 Request processed in 42992us (43611us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788658448.514049:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00010000:00010000:3.0:1788658448.519524:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.519556:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.519565:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.519571:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.519577:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.519585:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.519602:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658448.519605:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658448.519610:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.519616:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eabfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658448.532087:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658448.532190:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076469760 00000100:00100000:1.0:1788658448.532201:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076469760 00000100:00100000:1.0:1788658448.532260:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1788658448.532269:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:9707:x1875544076469760:12345-192.168.202.3@tcp:101:touch.500 00010000:00010000:1.0:1788658448.532294:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658448.532316:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eac04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad32 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658448.536253:0:11367:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3888us 00000100:00100000:3.0:1788658448.550799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.550846:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.550876:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076470016 00000100:00100000:3.0:1788658448.550886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076470016 00000100:00100000:3.0:1788658448.550956:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:3.0:1788658448.550967:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076470016:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658448.551045:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2354:x1875544076470016:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658448.551064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:3.0:1788658448.551090:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076469888 00000100:00100000:3.0:1788658448.551094:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076469888 00000100:00100000:3.0:1788658448.551117:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 248 00000100:00100000:3.0:1788658448.551124:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076469888:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658448.551150:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076469888:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658448.551157:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 248 00000100:00080000:3.0:1788658448.551180:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658448.553085:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553107:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553118:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553135:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553142:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553148:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553497:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc600/0xf657f176650eac19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553506:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc600/0xf657f176650eac19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553514:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc600/0xf657f176650eac19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658448.553536:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658448.553541:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658448.553587:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc600/0xf657f176650eac19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553599:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553605:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553612:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553617:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658448.553621:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553628:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553640:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:2.0:1788658448.553643:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658448.553647:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553653:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553688:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553696:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553711:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553715:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3ccc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658448.553718:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553725:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553733:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e56d579c000) 00010000:00010000:2.0:1788658448.553735:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658448.553738:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553744:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553780:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eac04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad32 expref: 8 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553796:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc600/0xf657f176650eac19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad32 expref: 7 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.553803:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658448.553805:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788658448.553807:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc600, rc 0) 00000100:00100000:2.0:1788658448.553875:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:9707:x1875544076469760:12345-192.168.202.3@tcp:101:touch.500 Request processed in 21606us (21798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.553892:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:3.0:1788658448.566754:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.567068:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076470272 00000100:00100000:0.0:1788658448.567079:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076470272 00000100:00100000:0.0:1788658448.567144:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1788658448.567154:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:9707:x1875544076470272:12345-192.168.202.3@tcp:101:touch.500 00010000:00010000:0.0:1788658448.567173:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658448.567195:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650eac20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad39 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.567452:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.567467:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.567478:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.567492:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.567504:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.567510:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658448.568392:0:6710:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788658448.568659:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eac35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570466:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eac35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570482:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eac35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570544:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570552:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570559:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570564:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658448.570569:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570578:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570611:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:0.0:1788658448.570614:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658448.570619:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570626:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658448.570643:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091f09ba8 reply state 00000000ed76656d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658448.570652:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788658448.570720:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650eac20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad39 expref: 10 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570735:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eac35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad39 expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.570742:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56c3c69f00) 00010000:00010000:0.0:1788658448.570745:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658448.570747:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78400, rc 0) 00000100:00100000:0.0:1788658448.570825:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:9707:x1875544076470272:12345-192.168.202.3@tcp:101:touch.500 Request processed in 3672us (4083us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788658448.570835:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00010000:00010000:3.0:1788658448.574717:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.574736:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.574743:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.574749:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.574754:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.574764:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.574959:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff9e56c3c69400) 00010000:00010000:3.0:1788658448.574962:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658448.574982:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.574990:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eac2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658448.575746:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.576266:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076470528 00000100:00100000:3.0:1788658448.576276:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076470528 00000100:00100000:3.0:1788658448.576340:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:3.0:1788658448.576350:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:9707:x1875544076470528:12345-192.168.202.3@tcp:36:touch.500 00010000:00010000:3.0:1788658448.576407:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658448.576427:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eac35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad39 expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.576441:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56c3c69f00) 00010000:00010000:3.0:1788658448.576450:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658448.576490:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.576502:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.576511:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658448.577087:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee77bb9a reply state 0000000008846082 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658448.577097:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658448.577195:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:9707:x1875544076470528:12345-192.168.202.3@tcp:36:touch.500 Request processed in 846us (1454us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788658448.577956:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:0.0:1788658448.580099:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1788658448.580888:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.580903:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.580920:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.580926:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658448.580932:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.580939:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.580959:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:1.0:1788658448.580963:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658448.580967:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.580993:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eac43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658448.583569:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076470656 00000100:00100000:3.0:1788658448.583585:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076470656 00000100:00100000:3.0:1788658448.583655:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:3.0:1788658448.583697:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:9707:x1875544076470656:12345-192.168.202.3@tcp:101:touch.500 00010000:00010000:3.0:1788658448.583723:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658448.583745:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eac4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad40 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.583811:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eac4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad40 expref: 10 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.583826:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eac4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad40 expref: 10 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.583842:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56d0810d00) 00010000:00010000:3.0:1788658448.583845:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658448.583849:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef600, rc 0) 00000100:00100000:3.0:1788658448.583924:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:9707:x1875544076470656:12345-192.168.202.3@tcp:101:touch.500 Request processed in 247us (3819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658448.583932:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:1.0:1788658448.587386:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.587502:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076470784 00000100:00100000:3.0:1788658448.587513:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076470784 00000100:00100000:3.0:1788658448.587561:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1788658448.587579:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875544076470784:12345-192.168.202.3@tcp:8:touch.500 00010000:00080000:3.0:1788658448.587611:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1788658448.587657:0:6687:0:(genops.c:1385:class_connect()) connect: client df8d83e3-27bc-4e5d-ab80-c17af5c0fb38, cookie 0xf657f176650eac51 00002000:00100000:3.0:1788658448.587927:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df8d83e3-27bc-4e5d-ab80-c17af5c0fb38/ffff9e5700408000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788658448.587940:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788658448.588169:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788658448.588200:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9e56c63d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658448.588369:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2350:x1875544076470784:12345-192.168.202.3@tcp:8:touch.500 Request processed in 790us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658448.588377:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:0.0:1788658448.593939:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.594090:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076470912 00000100:00100000:3.0:1788658448.594101:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076470912 00000100:00080000:0.0:1788658448.594490:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658448.594555:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:3.0:1788658448.594567:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:0:x1875544076470912:12345-192.168.202.3@tcp:2:touch.500 00000001:00080000:2.0:1788658448.647291:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1788658448.647309:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000100:00100000:0.0:1788658448.647370:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:0:x1875544076470912:12345-192.168.202.3@tcp:2:touch.500 Request processed in 52799us (53434us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788658448.647395:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1788658448.649698:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.650005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076471168 00000100:00100000:0.0:1788658448.650015:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076471168 00000100:00100000:0.0:1788658448.650077:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658448.650088:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:9707:x1875544076471168:12345-192.168.202.3@tcp:35:touch.500 00000100:00100000:0.0:1788658448.650420:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+11:9707:x1875544076471168:12345-192.168.202.3@tcp:35:touch.500 Request processed in 333us (759us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788658448.650428:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:2.0:1788658448.662227:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.662579:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076471296 00000100:00100000:0.0:1788658448.662588:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076471296 00000100:00100000:0.0:1788658448.662642:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:0.0:1788658448.662650:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+11:9709:x1875544076471296:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:0.0:1788658448.662716:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658448.662739:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650eac58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad47 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.662805:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.662821:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.662831:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658448.662860:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788658448.662863:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658448.662916:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.662947:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650eac58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad47 expref: 13 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.662966:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad47 expref: 12 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658448.662974:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:0.0:1788658448.662977:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658448.662980:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78000, rc 0) 00000100:00100000:0.0:1788658448.663332:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:9709:x1875544076471296:12345-192.168.202.3@tcp:101:rm.0 Request processed in 681us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658448.663340:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1788658448.667640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658448.668288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076471552 00000100:00100000:1.0:1788658448.668299:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076471552 00000100:00100000:2.0:1788658448.669597:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1788658448.669609:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:9709:x1875544076471552:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:2.0:1788658448.669630:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658448.669650:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad4e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658448.669782:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788658448.670118:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad4e expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.670133:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:2.0:1788658448.670136:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658448.670142:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad4e expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.670157:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3ccc00, rc 0) 00000100:00100000:2.0:1788658448.670713:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:9709:x1875544076471552:12345-192.168.202.3@tcp:101:rm.0 Request processed in 1104us (3078us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788658448.670721:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1788658448.677555:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658448.677658:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076471680 00000100:00100000:0.0:1788658448.677852:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076471680 00000100:00100000:0.0:1788658448.677951:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:0.0:1788658448.677966:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:9709:x1875544076471680:12345-192.168.202.3@tcp:37:rm.0 00000100:00100000:2.0:1788658448.687202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:9709:x1875544076471680:12345-192.168.202.3@tcp:37:rm.0 Request processed in 9231us (9645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.687223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:2.0:1788658448.696553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658448.697990:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076471936 00000100:00100000:1.0:1788658448.698003:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076471936 00000100:00100000:1.0:1788658448.698119:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:1.0:1788658448.698131:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:9709:x1875544076471936:12345-192.168.202.3@tcp:35:rm.0 00000100:00100000:1.0:1788658448.698425:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:9709:x1875544076471936:12345-192.168.202.3@tcp:35:rm.0 Request processed in 295us (1879us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788658448.698433:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:1.0:1788658448.702841:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658448.702917:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076472192 00000100:00100000:2.0:1788658448.702928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076472192 00000100:00100000:2.0:1788658448.702994:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:2.0:1788658448.703004:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:9709:x1875544076472192:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:2.0:1788658448.703028:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658448.703049:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.703148:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eac7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.703163:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eac7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.703174:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eac7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658448.703185:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788658448.703347:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad55 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.703376:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eac7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad55 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.703397:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658448.703400:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658448.703403:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc000, rc 0) 00000100:00100000:2.0:1788658448.703467:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:9709:x1875544076472192:12345-192.168.202.3@tcp:101:rm.0 Request processed in 464us (807us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788658448.703473:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:0.0:1788658448.706836:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658448.706944:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076472320 00000100:00100000:1.0:1788658448.706956:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076472320 00000100:00100000:1.0:1788658448.707021:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1788658448.707031:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:9709:x1875544076472320:12345-192.168.202.3@tcp:41:rm.0 00000004:00000024:1.0:1788658448.707094:0:6710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788658448.707166:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:9709:x1875544076472320:12345-192.168.202.3@tcp:41:rm.0 Request processed in 136us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658448.707172:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:0.0:1788658448.714462:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658448.718099:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076472448 00000100:00100000:2.0:1788658448.718115:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076472448 00000100:00100000:2.0:1788658448.718205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:2.0:1788658448.718217:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:9709:x1875544076472448:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:2.0:1788658448.718241:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658448.718264:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad5c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718334:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718350:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718372:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718390:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718397:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718424:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718542:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eac9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718551:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eac9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718558:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eac9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658448.718584:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788658448.718588:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658448.718607:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eac9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718619:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eac9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718627:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718633:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718640:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718646:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658448.718650:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718716:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718732:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658448.718735:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658448.718741:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718748:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc800/0xf657f176650eac90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718762:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718768:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718773:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718779:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cde00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658448.718781:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718786:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718793:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff9e56d579c000) 00010000:00010000:2.0:1788658448.718796:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658448.718799:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718815:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cde00/0xf657f176650eac97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718850:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650eac89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad5c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718864:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eac9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad5c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.718871:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56d0810d00) 00010000:00010000:2.0:1788658448.718873:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658448.718876:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891be00, rc 0) 00000100:00100000:2.0:1788658448.718966:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:9709:x1875544076472448:12345-192.168.202.3@tcp:101:rm.0 Request processed in 751us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.718973:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:2.0:1788658448.724047:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.724209:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076472704 00000100:00100000:3.0:1788658448.724220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076472704 00000100:00100000:3.0:1788658448.724280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:3.0:1788658448.724289:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:9709:x1875544076472704:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:3.0:1788658448.724342:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788658448.724379:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eac9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad5c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724398:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eac4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad40 expref: 16 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724408:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56d0810d00) 00010000:00010000:3.0:1788658448.724423:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650eac5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad47 expref: 15 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724453:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:3.0:1788658448.724457:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658448.724478:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724490:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724499:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724512:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724518:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724524:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724646:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724654:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.724660:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658448.725394:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788658448.725406:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339864740112ns, next at 340864737885ns, rc = 0 00010000:00010000:3.0:1788658448.725470:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725481:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725489:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725497:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725502:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725508:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725531:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658448.725553:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725560:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725566:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725571:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eee00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.725575:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725582:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725599:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:3.0:1788658448.725602:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788658448.725607:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725612:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725627:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725634:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725639:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725645:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.725647:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725652:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725659:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:3.0:1788658448.725661:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658448.725691:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.725697:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eaca5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658448.725716:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b7b4d73 reply state 00000000ebb25a38 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658448.725723:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658448.725796:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:9709:x1875544076472704:12345-192.168.202.3@tcp:36:rm.0 Request processed in 1505us (1757us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788658448.725804:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00010000:00010000:2.0:1788658448.726051:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658448.726058:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.726064:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eea00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658448.726068:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.726075:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.726084:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:2.0:1788658448.726092:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788658448.726096:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.726102:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eacba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.726117:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658448.726120:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658448.726121:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658448.734187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1788658448.734367:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.734382:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.734390:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.734396:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658448.734402:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.734410:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.734429:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff9e56d0810200) 00010000:00010000:2.0:1788658448.734433:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658448.734437:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658448.734443:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eacac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658448.734562:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076472960 00000100:00100000:3.0:1788658448.734572:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076472960 00000100:00100000:3.0:1788658448.734630:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1788658448.734641:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:9709:x1875544076472960:12345-192.168.202.3@tcp:35:rm.0 00000100:00100000:3.0:1788658448.734924:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:9709:x1875544076472960:12345-192.168.202.3@tcp:35:rm.0 Request processed in 283us (745us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788658448.734932:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1788658448.737735:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658448.737904:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076473216 00000100:00100000:3.0:1788658448.737913:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076473216 00000100:00100000:3.0:1788658448.737978:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:3.0:1788658448.737988:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:9709:x1875544076473216:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:3.0:1788658448.738060:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788658448.738094:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc000/0xf657f176650eac7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad55 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738120:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cc600/0xf657f176650eac19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad32 expref: 15 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738131:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:3.0:1788658448.738159:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eabda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad24 expref: 14 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738168:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658448.738176:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658448.738200:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738213:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738223:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738234:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738241:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738247:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738491:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738500:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.738507:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658448.739057:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788658448.739076:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739084:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739091:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739097:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.739101:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739109:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739118:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e56d0810100) 00010000:00010000:3.0:1788658448.739121:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788658448.739125:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739130:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eaccf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739149:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739155:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739161:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739166:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658448.739175:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739182:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739189:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d0810d00) 00010000:00010000:3.0:1788658448.739191:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658448.739194:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658448.739199:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef800/0xf657f176650eacc1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658448.739210:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000584ba3bd reply state 00000000e6376aa4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658448.739219:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658448.739953:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:9709:x1875544076473216:12345-192.168.202.3@tcp:36:rm.0 Request processed in 1959us (2221us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788658448.739963:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00010000:00010000:1.0:1788658448.743811:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.743829:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.743856:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.743862:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eee00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658448.743866:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.743874:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.743891:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e56d0810500) 00010000:00010000:1.0:1788658448.743906:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658448.743910:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658448.743916:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eacc8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658448.797108:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103767936:0@lo:400:kworker.0 00000100:00100000:2.0:1788658448.797182:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658448.797260:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658448.797268:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103767808:0@lo:400:kworker.0 00000100:00100000:2.0:1788658448.797293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658448.797322:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767936 00000100:00100000:2.0:1788658448.797329:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767936 00000100:00100000:2.0:1788658448.797398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767808 00000100:00100000:2.0:1788658448.797401:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767808 00000100:00100000:2.0:1788658448.797421:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788658448.797428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103767936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658448.797475:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103767936:12345-0@lo:400:kworker.0 Request processed in 47us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.797482:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788658448.797497:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788658448.797503:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103767808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658448.797529:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103767808:12345-0@lo:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.797534:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788658448.797550:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658448.797578:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103767808:0@lo:400:kworker.0 00000100:00100000:2.0:1788658448.797588:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103767936:0@lo:400:kworker.0 00000100:00100000:0.0:1788658448.797704:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103768064:0@lo:400:kworker.0 00000100:00100000:0.0:1788658448.797735:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658448.797760:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788658448.797766:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103767680:0@lo:400:kworker.0 00000100:00100000:0.0:1788658448.797809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658448.797833:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103768192:0@lo:400:kworker.0 00000100:00100000:0.0:1788658448.797856:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658448.797880:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103767680 00000100:00100000:0.0:1788658448.797883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103767680 00000100:00100000:0.0:1788658448.797917:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788658448.797923:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103767680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658448.797952:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103767680:12345-0@lo:400:kworker.0 Request processed in 29us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658448.797958:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788658448.797982:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103768192 00000100:00100000:0.0:1788658448.797985:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103768192 00000100:00100000:0.0:1788658448.798009:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788658448.798014:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103768192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658448.798038:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103768192:12345-0@lo:400:kworker.0 Request processed in 24us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658448.798043:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788658448.798059:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658448.798071:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103767680:0@lo:400:kworker.0 00010000:00080000:0.0:1788658448.798081:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834ca80 x1875544103768192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658448.798091:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103768192:0@lo:400:kworker.0 00000100:00100000:2.0:1788658448.798535:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103768064 00000100:00100000:2.0:1788658448.798540:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103768064 00000100:00100000:2.0:1788658448.798585:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788658448.798600:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103768064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658448.798636:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103768064:12345-0@lo:400:kworker.0 Request processed in 38us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.798642:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788658448.799052:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658448.799077:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103768064:0@lo:400:kworker.0 00010000:00010000:0.0:1788658449.117038:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658449.311607:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658449.311632:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103768320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658449.311727:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658449.311951:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103768320 00000100:00100000:2.0:1788658449.311959:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103768320 00000100:00100000:2.0:1788658449.312019:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658449.312029:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103768320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658449.312064:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658449.312115:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103768320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658449.312122:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788658449.312735:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c834c380 x1875544103768320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658449.312755:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103768320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788658450.148447:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658451.164805:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658452.192733:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658452.513631:0:11618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788658453.219817:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788658453.406697:0:6734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344546029586ns, next at 345546027116ns, rc = 0 00000100:00100000:2.0:1788658453.406781:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658453.406842:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103768448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658453.406916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658453.407040:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103768448 00000100:00100000:1.0:1788658453.407048:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103768448 00000100:00100000:1.0:1788658453.407112:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788658453.407122:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103768448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658453.407157:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658453.407204:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103768448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658453.407211:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788658453.407412:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658453.408453:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005a9500 x1875544103768448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658453.408478:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103768448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658453.671032:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658453.671071:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658453.671111:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658453.671134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658453.671160:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076473472 00000100:00100000:3.0:1788658453.671168:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076473472 00000100:00100000:3.0:1788658453.671223:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076473728 00000100:00100000:3.0:1788658453.671225:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076473728 00000100:00100000:3.0:1788658453.671249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:3.0:1788658453.671257:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2351:x1875544076473472:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658453.671326:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2351:x1875544076473472:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658453.671346:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:3.0:1788658453.671360:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 105 00000100:00100000:3.0:1788658453.671365:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076473728:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658453.671386:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076473728:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 21us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658453.671392:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 105 00000100:00100000:3.0:1788658453.671409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076473344 00000100:00100000:3.0:1788658453.671412:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076473344 00000100:00100000:3.0:1788658453.671433:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 250 00000100:00100000:3.0:1788658453.671439:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076473344:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658453.671463:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076473344:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 24us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658453.671468:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 250 00000100:00080000:3.0:1788658453.671491:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658453.671731:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076473600 00000100:00100000:1.0:1788658453.671735:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076473600 00000100:00100000:1.0:1788658453.671770:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:1.0:1788658453.671776:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076473600:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658453.671799:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076473600:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 24us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658453.671804:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00080000:3.0:1788658453.672346:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788658453.713431:0:11666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd13e8a000 20000000:00000080:1.0:1788658453.713448:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e56debf7800 uarg=0000000000000000 20000000:01000000:1.0:1788658453.713484:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788658453.713490:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788658453.713494:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788658453.715386:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788658453.715544:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788658453.722093:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788658453.722228:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788658453.722279:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788658453.722296:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788658453.722316:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722347:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722356:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722364:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab86 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722371:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eab94 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722384:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eaba2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722392:0:11666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722429:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eaba2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722442:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eaba2 expref: 18 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.722457:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768576:0@lo:104: 00000100:00100000:1.0:1788658453.722516:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658453.722609:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eab94 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.722618:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eab94 expref: 18 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.722626:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768704:0@lo:104: 00000100:00100000:1.0:1788658453.722658:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658453.723255:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650eab86 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.723264:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650eab86 expref: 18 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.723274:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768832:0@lo:104: 00000100:00100000:1.0:1788658453.723305:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658453.723321:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103768576 00000100:00100000:3.0:1788658453.723337:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103768576 00000100:00100000:2.0:1788658453.723411:0:8509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103768704 00000100:00100000:2.0:1788658453.723415:0:8509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103768704 00000100:00100000:3.0:1788658453.723449:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658453.723457:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+4:11666:x1875544103768576:12345-0@lo:104: 00010000:00010000:3.0:1788658453.723470:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658453.723514:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788658453.723520:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+4:11666:x1875544103768576:12345-0@lo:104: Request processed in 64us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658453.723526:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658453.723542:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658453.723547:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:11666:x1875544103768704:12345-0@lo:104: 00010000:00010000:3.0:1788658453.723554:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658453.723581:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788658453.723585:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88ab4306-42c5-43ae-b202-256d86278024+3:11666:x1875544103768704:12345-0@lo:104: Request processed in 39us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658453.723591:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788658453.723706:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.723717:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 12 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.723727:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768960:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658453.723777:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.723785:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 12 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.723794:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103769088:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658453.723811:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff9589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658453.723830:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768576:0@lo:104: 00000100:00100000:1.0:1788658453.723837:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768704:0@lo:104: 00000100:00100000:0.0:1788658453.724004:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788658453.724014:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103768832 00000100:00100000:0.0:1788658453.724017:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103768832 00000100:00100000:0.0:1788658453.724036:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658453.724042:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff377850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:11666:x1875544103768832:12345-0@lo:104: 00010000:00010000:0.0:1788658453.724049:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724092:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788658453.724097:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff377850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88ab4306-42c5-43ae-b202-256d86278024+3:11666:x1875544103768832:12345-0@lo:104: Request processed in 56us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658453.724112:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788658453.724145:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788658453.724150:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724157:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658453.724161:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724170:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658453.724177:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658453.724183:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658453.724207:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724222:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658453.724242:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724249:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007ef400/0xf657f176650eaba2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eaba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724260:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658453.724263:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724269:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cda00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658453.724272:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724279:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658453.724285:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658453.724291:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658453.724302:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724306:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658453.724311:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724318:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cda00/0xf657f176650eab94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724342:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658453.724345:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724351:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658453.724353:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724361:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658453.724367:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658453.724372:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658453.724383:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724389:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658453.724403:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724409:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650eab86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650eab8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724420:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658453.724422:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658453.724424:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658453.724434:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103769216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658453.724463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658453.724482:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658453.724488:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103769344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658453.724503:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658453.724524:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103769472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658453.724544:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658453.724567:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103769216 00000100:00100000:0.0:1788658453.724570:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103769216 00010000:00010000:0.0:1788658453.724585:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eaba2 expref: 19 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658453.724601:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103769344 00000100:00100000:0.0:1788658453.724604:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103769344 00010000:00010000:0.0:1788658453.724612:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab94 expref: 20 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658453.724621:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103769472 00000100:00100000:0.0:1788658453.724623:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103769472 00010000:00010000:0.0:1788658453.724806:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab86 expref: 21 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658453.724822:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658453.724829:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+21:3304:x1875544103769216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658453.724838:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658453.724843:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eaba2 expref: 21 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724854:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eaba2 expref: 21 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724875:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cd400/0xf657f176650eaba9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eaba2 expref: 21 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724886:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658453.724909:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+20:3304:x1875544103769216:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658453.724916:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658453.724928:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658453.724933:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103769344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658453.724939:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658453.724943:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab94 expref: 19 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724951:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eab94 expref: 19 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724960:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ee600/0xf657f176650eab9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eab94 expref: 19 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.724967:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658453.724983:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+18:3304:x1875544103769344:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658453.724988:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658453.724997:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658453.725002:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8934450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+17:3306:x1875544103769472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658453.725008:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658453.725012:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650eab86 expref: 17 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.725025:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650eab86 expref: 17 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658453.725034:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658453.725055:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8934450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+17:3306:x1875544103769472:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658453.725061:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658453.725168:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103769472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658453.725190:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103769344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658453.725197:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103769216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658453.725336:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679600/0xf657f176650eab8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650eab86 expref: 16 pid: 5832 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.725347:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768832:0@lo:104: 00000100:00100000:2.0:1788658453.728830:0:8509:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:2.0:1788658453.732063:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658453.732074:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658453.732476:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1788658453.733051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658453.733079:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658453.733138:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076473984 00000100:00100000:2.0:1788658453.733147:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076473984 00010000:00010000:2.0:1788658453.733182:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 13 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658453.733229:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076473856 00000100:00100000:2.0:1788658453.733232:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076473856 00010000:00010000:2.0:1788658453.733244:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 14 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658453.733261:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1788658453.733270:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+14:2351:x1875544076473984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658453.733283:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658453.733288:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 14 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733299:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 14 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733317:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658453.733373:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+14:2351:x1875544076473984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658453.733381:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1788658453.733396:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:2.0:1788658453.733402:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076473856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658453.733410:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658453.733414:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 13 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733424:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 13 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733445:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733454:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733467:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733474:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733481:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733487:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733493:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658453.733498:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733516:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733525:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.733534:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658453.733550:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076473856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 149us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658453.733564:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00010000:00010000:1.0:1788658453.735035:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679c00/0xf657f176650eab7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad16 expref: 12 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.735054:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103768960:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658453.735082:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ee000/0xf657f176650eab78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad0f expref: 11 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658453.735120:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875544103769088:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658453.735150:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.735160:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.735167:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658453.735174:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678600/0xf657f176650eacd6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658453.916952:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103769600:0@lo:400:kworker.0 00000100:00100000:3.0:1788658453.917028:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658453.917080:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103770112:0@lo:400:kworker.0 00000100:00100000:3.0:1788658453.917106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658453.917140:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658453.917146:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103769984:0@lo:400:kworker.0 00000100:00100000:3.0:1788658453.917170:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658453.917202:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103769984 00000100:00100000:3.0:1788658453.917209:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103769984 00000100:00100000:3.0:1788658453.917252:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658453.917260:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103769984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658453.917348:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103769984:12345-0@lo:400:kworker.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658453.917355:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788658453.917394:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e2d80 x1875544103769984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658453.917405:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103769984:0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917518:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103769728:0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917546:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658453.917565:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103770240:0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658453.917599:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658453.917604:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103769856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917635:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658453.917690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103770112 00000100:00100000:0.0:1788658453.917693:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103770112 00000100:00100000:0.0:1788658453.917727:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103769728 00000100:00100000:0.0:1788658453.917730:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103769728 00000100:00100000:0.0:1788658453.917742:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103769856 00000100:00100000:0.0:1788658453.917744:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103769856 00000100:00100000:0.0:1788658453.917767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658453.917773:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103770112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917806:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103770112:12345-0@lo:400:kworker.0 Request processed in 33us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658453.917812:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658453.917825:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788658453.917830:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103769728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917859:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103769728:12345-0@lo:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658453.917865:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788658453.917876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788658453.917882:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917903:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103769856:12345-0@lo:400:kworker.0 Request processed in 23us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658453.917909:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788658453.917925:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658453.917944:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103769856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917953:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103769728:0@lo:400:kworker.0 00000100:00100000:0.0:1788658453.917974:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103770112:0@lo:400:kworker.0 00000100:00100000:2.0:1788658453.918098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103769600 00000100:00100000:2.0:1788658453.918103:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103769600 00000100:00100000:2.0:1788658453.918136:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788658453.918143:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:3307:x1875544103769600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658453.918178:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+16:3307:x1875544103769600:12345-0@lo:400:kworker.0 Request processed in 35us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658453.918183:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788658453.918626:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103769600:0@lo:400:kworker.0 00000100:00100000:1.0:1788658453.918952:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103770240 00000100:00100000:1.0:1788658453.918957:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103770240 00000100:00100000:1.0:1788658453.919042:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788658453.919050:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103770240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658453.919100:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103770240:12345-0@lo:400:kworker.0 Request processed in 50us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658453.919105:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788658453.919134:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e1880 x1875544103770240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658453.919145:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103770240:0@lo:400:kworker.0 00000100:00080000:0.0:1788658453.919351:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788658453.971464:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000004:00080000:2.0:1788658453.971487:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788658453.971506:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:2.0:1788658453.971511:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:2.0:1788658453.971518:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788658453.971524:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788658453.971732:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658453.971750:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103770368:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788658453.971813:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658453.971949:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103770368 00000100:00100000:3.0:1788658453.971956:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103770368 00000100:00100000:3.0:1788658453.971997:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658453.972006:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103770368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788658453.972030:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788658453.972061:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9cc310, atime: 0x6a9cc310, ctime: 0x6a9cc310, blocks: 0x1 00010000:00010000:3.0:1788658453.972068:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658453.972085:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788658453.972089:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658453.972095:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658453.972123:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658453.972134:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658453.972141:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658453.972157:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658453.973232:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875544103770368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1223us (1415us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788658453.973241:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1788658453.973332:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e56ff01dc00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788658453.973339:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103770368:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788658453.973384:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658453.973393:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.973403:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658453.973409:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.973420:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.973441:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.973463:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eacdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658453.973482:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658453.973484:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658453.973486:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658454.239108:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658454.435843:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103770496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658454.435920:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658454.436763:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103770496 00000100:00100000:2.0:1788658454.436773:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103770496 00000100:00100000:2.0:1788658454.436833:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788658454.436843:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103770496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658454.436879:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658454.436948:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103770496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658454.436956:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788658454.437064:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e1500 x1875544103770496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658454.437083:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103770496:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788658455.132819:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658455.132828:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56fef6c800 from 7 10000000:01000000:1.0:1788658455.132833:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658455.132883:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658455.132895:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658455.132906:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658455.132931:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103770624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.133001:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.133079:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658455.133256:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103770624 00000100:00100000:3.0:1788658455.133263:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103770624 00000100:00100000:3.0:1788658455.133324:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788658455.133342:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+16:5834:x1875544103770624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658455.133354:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658455.133369:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007ef800/0xf657f176650eaceb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eace4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.133409:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ef800/0xf657f176650eaceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eace4 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.133420:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007ef800/0xf657f176650eaceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eace4 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.133429:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef800, rc 0) 00000100:00100000:3.0:1788658455.133473:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103770624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658455.133480:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788658455.133804:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103770624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658455.133820:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658455.133830:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658455.133885:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103770752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.133912:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.133939:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658455.133992:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103770752 00000100:00100000:2.0:1788658455.133997:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103770752 00000100:00100000:2.0:1788658455.134034:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788658455.134041:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103770752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.134307:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103770752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.134314:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788658455.134855:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103770752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.134906:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103770880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.134949:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.134979:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658455.136048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103770880 00000100:00100000:2.0:1788658455.136058:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103770880 00000100:00100000:2.0:1788658455.136112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788658455.136121:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103770880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.136512:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103770880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 391us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.136521:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788658455.136744:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103770880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.137348:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11681:1875544103771008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658455.137399:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.137437:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658455.137544:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771008 00000100:00100000:0.0:1788658455.137556:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771008 00000100:00100000:0.0:1788658455.137610:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788658455.137618:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+17:11681:x1875544103771008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658455.137835:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d0b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+17:11681:x1875544103771008:12345-0@lo:502:llog_process_th.0 Request processed in 217us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.137843:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788658455.138199:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11681:1875544103771008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658455.138226:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658455.138236:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658455.138238:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658455.138245:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56fef6c800 00000020:00000080:1.0:1788658455.138247:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788658455.138338:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11681:1875544103771136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658455.138376:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.138409:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658455.138529:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771136 00000100:00100000:3.0:1788658455.138533:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771136 00000100:00100000:3.0:1788658455.138584:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788658455.138592:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:11681:x1875544103771136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658455.138776:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:11681:x1875544103771136:12345-0@lo:502:llog_process_th.0 Request processed in 185us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658455.138785:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788658455.139189:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11681:1875544103771136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658455.139213:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658455.139218:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658455.139220:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788658455.139224:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788658455.139549:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788658455.139586:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658455.139598:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.139609:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658455.139621:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658455.139624:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e57014ee800 from 7 10000000:01000000:2.0:1788658455.139627:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658455.139656:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.139693:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.139704:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658455.139720:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.139756:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.139791:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658455.140131:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771264 00000100:00100000:3.0:1788658455.140138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771264 00000100:00100000:3.0:1788658455.140189:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788658455.140197:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+17:5834:x1875544103771264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658455.140207:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658455.140220:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007ee200/0xf657f176650eacf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650eacf2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.140243:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ee200/0xf657f176650eacf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650eacf2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.140265:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007ee200/0xf657f176650eacf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650eacf2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.140274:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee200, rc 0) 00000100:00100000:3.0:1788658455.140321:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103771264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658455.140336:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788658455.141147:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658455.141175:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.141195:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658455.141253:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.141287:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.141398:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca180 going to sleep for 11 seconds 00000100:00100000:1.0:1788658455.142058:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771392 00000100:00100000:1.0:1788658455.142064:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771392 00000100:00100000:1.0:1788658455.142111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788658455.142120:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103771392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.142963:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103771392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 841us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.142973:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788658455.150448:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.150514:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.150595:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.150632:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788658455.150655:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771520 00000100:00100000:2.0:1788658455.150661:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771520 00000100:00100000:2.0:1788658455.150727:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788658455.150737:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103771520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.150912:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103771520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.150920:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788658455.150982:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.151187:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11684:1875544103771648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658455.151222:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.151247:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658455.155593:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771648 00000100:00100000:1.0:1788658455.155610:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771648 00000100:00100000:1.0:1788658455.155705:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788658455.155716:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:11684:x1875544103771648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658455.155986:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+18:11684:x1875544103771648:12345-0@lo:502:llog_process_th.0 Request processed in 272us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.155995:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788658455.162780:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11684:1875544103771648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658455.162832:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658455.162855:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658455.162858:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788658455.162864:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e57014ee800 00000020:00000080:2.0:1788658455.162867:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658455.179715:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11684:1875544103771776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658455.179812:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.179851:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658455.180635:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771776 00000100:00100000:3.0:1788658455.180646:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771776 00000100:00100000:3.0:1788658455.180724:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788658455.180734:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:11684:x1875544103771776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658455.180980:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+18:11684:x1875544103771776:12345-0@lo:502:llog_process_th.0 Request processed in 247us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658455.180988:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788658455.182598:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11684:1875544103771776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658455.182639:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658455.182648:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658455.182650:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788658455.182654:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788658455.183059:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788658455.183077:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658455.183088:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.183101:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658455.183112:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658455.183114:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56f44c2000 from 7 10000000:01000000:3.0:1788658455.183117:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658455.183150:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.183181:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658455.183192:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658455.183212:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c1302680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658455.183264:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658455.183304:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658455.184021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103771904 00000100:00100000:2.0:1788658455.184029:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103771904 00000100:00100000:2.0:1788658455.184067:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788658455.184076:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+18:5834:x1875544103771904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658455.184088:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658455.184102:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891a400/0xf657f176650ead07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ead00 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.184126:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891a400/0xf657f176650ead07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ead00 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.184139:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891a400/0xf657f176650ead07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ead00 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.184148:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a400, rc 0) 00000100:00100000:2.0:1788658455.184211:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103771904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.184227:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788658455.184299:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c1302680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103771904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658455.184315:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658455.184335:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658455.184390:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103772032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.184417:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.184450:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658455.184572:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772032 00000100:00100000:3.0:1788658455.184594:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772032 00000100:00100000:3.0:1788658455.184628:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788658455.184635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103772032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658455.184907:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103772032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658455.184914:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788658455.188105:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103772032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658455.188182:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c1300700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103772160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658455.188254:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658455.188301:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118e0c0 going to sleep for 11 seconds 00000040:00080000:3.0:1788658455.191115:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658455.204049:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772160 00000100:00100000:0.0:1788658455.204062:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772160 00000100:00100000:0.0:1788658455.204124:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788658455.204134:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103772160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658455.204379:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:5834:x1875544103772160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 247us (16124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.204387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788658455.204448:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c1300700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88ab4306-42c5-43ae-b202-256d86278024:5834:1875544103772160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658455.211338:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11686:1875544103772288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658455.211418:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658455.211470:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658455.211547:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772288 00000100:00100000:1.0:1788658455.211554:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772288 00000100:00100000:1.0:1788658455.211601:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788658455.211611:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:11686:x1875544103772288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658455.211874:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:11686:x1875544103772288:12345-0@lo:502:llog_process_th.0 Request processed in 264us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.211891:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788658455.212085:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11686:1875544103772288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658455.212117:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658455.212127:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658455.212129:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788658455.212136:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56f44c2000 00000020:00000080:0.0:1788658455.212139:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788658455.212224:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11686:1875544103772416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658455.212259:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658455.212297:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658455.212327:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772416 00000100:00100000:0.0:1788658455.212331:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772416 00000100:00100000:0.0:1788658455.212354:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788658455.212361:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:11686:x1875544103772416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658455.212491:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:11686:x1875544103772416:12345-0@lo:502:llog_process_th.0 Request processed in 129us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.212498:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788658455.212537:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88ab4306-42c5-43ae-b202-256d86278024:11686:1875544103772416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658455.212554:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658455.212559:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658455.212560:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788658455.212563:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788658455.226426:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788658455.226475:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658455.226489:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658455.226503:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.271661:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658455.527853:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658455.527959:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076474112 00000100:00100000:0.0:1788658455.527970:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076474112 00000100:00100000:0.0:1788658455.528029:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 267 00000100:00100000:0.0:1788658455.528039:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:5592:x1875544076474112:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658455.528056:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658455.528073:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79000/0xf657f176650ead0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad63 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658455.528102:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79000/0xf657f176650ead0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad63 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658455.528161:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79000/0xf657f176650ead0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad63 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658455.528170:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79000, rc 0) 00000100:00100000:0.0:1788658455.528241:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076474112:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 203us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.528248:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 267 00000100:00100000:2.0:1788658455.540196:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658455.540304:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076474240 00000100:00100000:1.0:1788658455.540314:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076474240 00000100:00100000:1.0:1788658455.540371:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 268 00000100:00100000:1.0:1788658455.540381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076474240:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658455.540705:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076474240:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 324us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.540712:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 268 00000100:00100000:3.0:1788658455.548624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658455.548763:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076474368 00000100:00100000:2.0:1788658455.548773:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076474368 00000100:00100000:2.0:1788658455.548829:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 269 00000100:00100000:2.0:1788658455.548839:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076474368:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.549083:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076474368:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 244us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.549091:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 269 00000100:00100000:2.0:1788658455.553147:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658455.553301:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076474496 00000100:00100000:0.0:1788658455.553312:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076474496 00000100:00100000:0.0:1788658455.553367:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 270 00000100:00100000:0.0:1788658455.553377:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:9980:x1875544076474496:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658455.553647:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:9980:x1875544076474496:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 271us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.553655:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 270 00000100:00100000:2.0:1788658455.564770:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658455.564867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076474624 00000100:00100000:1.0:1788658455.564878:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076474624 00000100:00100000:1.0:1788658455.564937:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 271 00000100:00100000:1.0:1788658455.564948:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:9980:x1875544076474624:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658455.565236:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:9980:x1875544076474624:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 289us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.565245:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 271 00000100:00100000:3.0:1788658455.574414:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658455.574810:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076474752 00000100:00100000:2.0:1788658455.574819:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076474752 00000100:00100000:2.0:1788658455.574874:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 272 00000100:00100000:2.0:1788658455.574883:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:5592:x1875544076474752:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658455.574909:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658455.574928:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891ba00/0xf657f176650ead15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.574957:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891ba00/0xf657f176650ead15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad6a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.574968:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891ba00/0xf657f176650ead15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad6a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658455.574994:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ba00, rc 0) 00000100:00100000:2.0:1788658455.575050:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076474752:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 167us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.575057:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 272 00000100:00100000:2.0:1788658455.577782:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658455.582636:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076474880 00000100:00100000:0.0:1788658455.582653:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076474880 00000100:00100000:0.0:1788658455.582810:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 273 00000100:00100000:0.0:1788658455.582822:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076474880:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658455.583130:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076474880:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 309us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.583139:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 273 00000100:00100000:3.0:1788658455.585062:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658455.592573:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475008 00000100:00100000:2.0:1788658455.592590:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475008 00000100:00100000:2.0:1788658455.592651:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 274 00000100:00100000:2.0:1788658455.592661:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076475008:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658455.592904:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:5592:x1875544076475008:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 242us (7853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.592913:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 274 00000100:00100000:3.0:1788658455.597945:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658455.598073:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475136 00000100:00100000:2.0:1788658455.598087:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475136 00000100:00100000:2.0:1788658455.598801:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 275 00000100:00100000:2.0:1788658455.598814:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:9983:x1875544076475136:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658455.599100:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:9983:x1875544076475136:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 287us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.599123:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 275 00000100:00100000:2.0:1788658455.605527:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658455.605626:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475264 00000100:00100000:0.0:1788658455.605720:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475264 00000100:00100000:0.0:1788658455.605774:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 276 00000100:00100000:0.0:1788658455.605785:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:9983:x1875544076475264:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658455.606387:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:9983:x1875544076475264:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 602us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.606397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 276 00000040:00080000:3.0:1788658456.222909:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788658456.284901:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658457.309176:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658458.334786:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658458.526176:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103772544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658458.526267:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658458.526467:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772544 00000100:00100000:2.0:1788658458.526477:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772544 00000100:00100000:2.0:1788658458.526551:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658458.526572:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103772544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658458.526606:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658458.526655:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103772544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658458.526662:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788658458.527249:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658458.527295:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103772544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658458.792786:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658458.792822:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658458.792862:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658458.792889:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658458.793078:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475520 00000100:00100000:0.0:1788658458.793089:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475520 00000100:00100000:0.0:1788658458.793152:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475776 00000100:00100000:0.0:1788658458.793155:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475776 00000100:00100000:0.0:1788658458.793177:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:0.0:1788658458.793187:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076475520:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658458.793260:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076475520:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 73us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658458.793279:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:0.0:1788658458.793298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:0.0:1788658458.793305:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076475776:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658458.793329:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076475776:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658458.793335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:2.0:1788658458.793726:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475392 00000100:00100000:2.0:1788658458.793731:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475392 00000100:00100000:2.0:1788658458.793771:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 277 00000100:00100000:2.0:1788658458.793778:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2352:x1875544076475392:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658458.793815:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2352:x1875544076475392:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 38us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658458.793821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 277 00000100:00100000:1.0:1788658458.794029:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475648 00000100:00100000:1.0:1788658458.794034:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475648 00000100:00100000:1.0:1788658458.794085:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:1.0:1788658458.794106:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076475648:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658458.794142:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076475648:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 37us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658458.794148:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00080000:3.0:1788658458.798726:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658458.798737:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658459.041038:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103773056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658459.041113:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658459.041178:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658459.041185:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103772928:0@lo:400:kworker.0 00000100:00100000:0.0:1788658459.041213:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658459.042436:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c1302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103772800:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.042500:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658459.042534:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103773312:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.042560:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658459.042592:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788658459.042599:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c1300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103772672:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.042627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658459.042647:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103773184:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.042686:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658459.042769:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773056 00000100:00100000:2.0:1788658459.042777:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773056 00000100:00100000:2.0:1788658459.042819:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773312 00000100:00100000:2.0:1788658459.042822:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773312 00000100:00100000:2.0:1788658459.042850:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788658459.042872:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103773056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.042923:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103773056:12345-0@lo:400:kworker.0 Request processed in 52us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658459.042930:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788658459.042947:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658459.042952:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103773312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.042983:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103773312:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658459.042989:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788658459.043022:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57014bce00 x1875544103773312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658459.043159:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658459.043193:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772928 00000100:00100000:3.0:1788658459.043198:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772928 00000100:00100000:3.0:1788658459.043227:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772800 00000100:00100000:3.0:1788658459.043230:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772800 00000100:00100000:3.0:1788658459.043332:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773184 00000100:00100000:3.0:1788658459.043336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773184 00000100:00100000:3.0:1788658459.043353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788658459.043359:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103772928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658459.043395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103772928:12345-0@lo:400:kworker.0 Request processed in 36us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658459.043401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788658459.043413:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788658459.043420:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103772800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658459.043445:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103772800:12345-0@lo:400:kworker.0 Request processed in 27us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658459.043451:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788658459.043461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788658459.043467:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103773184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658459.043492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103773184:12345-0@lo:400:kworker.0 Request processed in 26us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658459.043506:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788658459.043520:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658459.043560:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103772672 00000100:00100000:3.0:1788658459.043564:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103772672 00000100:00100000:3.0:1788658459.043591:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788658459.043597:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103772672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658459.043628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103772672:12345-0@lo:400:kworker.0 Request processed in 31us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658459.043634:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788658459.046594:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103772928:0@lo:400:kworker.0 00000100:00100000:0.0:1788658459.046617:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103773056:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.046789:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103773312:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.046813:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c1300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103772672:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.046826:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103773184:0@lo:400:kworker.0 00000100:00100000:2.0:1788658459.046835:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c1302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103772800:0@lo:400:kworker.0 00000001:00080000:1.0:1788658459.141106:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788658459.356900:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658459.549223:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658459.549247:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103773440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658459.549338:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658459.549550:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773440 00000100:00100000:2.0:1788658459.549559:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773440 00000100:00100000:2.0:1788658459.549611:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788658459.549621:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103773440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658459.549701:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658459.549749:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103773440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658459.549756:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788658459.551569:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57007e1180 x1875544103773440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658459.551594:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103773440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788658460.380992:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658461.405685:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658462.428939:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658463.454099:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658463.645468:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103773568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658463.645539:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658463.645601:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773568 00000100:00100000:2.0:1788658463.645610:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773568 00000100:00100000:1.0:1788658463.645698:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788658463.645700:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658463.646053:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103773568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658463.646084:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658463.646143:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103773568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 436us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658463.646149:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788658463.646260:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788658463.646265:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e56ff01dc00, transno 4294967300 00000100:00100000:0.0:1788658463.646333:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103773568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658463.911916:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658463.912009:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658463.912036:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658463.912068:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476160 00000100:00100000:2.0:1788658463.912073:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658463.912079:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476160 00000100:00100000:2.0:1788658463.912116:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476032 00000100:00100000:2.0:1788658463.912121:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476032 00000100:00100000:3.0:1788658463.912153:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:2.0:1788658463.912171:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476288 00000100:00100000:2.0:1788658463.912176:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476288 00000100:00100000:2.0:1788658463.912200:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:2.0:1788658463.912208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076476032:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658463.912229:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076476160:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658463.912313:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:1.0:1788658463.912322:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2352:x1875544076476288:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658463.912380:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076476160:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 217us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658463.912388:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00080000:3.0:1788658463.912414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658463.912418:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658463.912440:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076476032:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658463.912449:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:0.0:1788658463.913697:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076475904 00000100:00100000:0.0:1788658463.913707:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076475904 00000100:00100000:0.0:1788658463.913765:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 279 00000100:00100000:0.0:1788658463.913775:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2352:x1875544076475904:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658463.913999:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2352:x1875544076475904:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 225us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658463.914007:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 279 00000100:00100000:1.0:1788658463.914195:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2352:x1875544076476288:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1873us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658463.914205:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:0.0:1788658464.158824:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103773696:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.160602:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658464.160709:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.160797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658464.160839:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788658464.160847:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103773824:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.160881:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658464.160900:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.162599:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658464.162661:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103773952:0@lo:400:kworker.0 00000100:00100000:1.0:1788658464.162793:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774208 00000100:00100000:1.0:1788658464.162804:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774208 00000100:00100000:2.0:1788658464.163550:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774336 00000100:00100000:2.0:1788658464.163557:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774336 00000100:00100000:2.0:1788658464.163605:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788658464.163616:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103774336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658464.163727:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103774336:12345-0@lo:400:kworker.0 Request processed in 112us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658464.163735:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788658464.163877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658464.164073:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658464.164084:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.164113:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658464.164156:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773824 00000100:00100000:0.0:1788658464.164161:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773824 00000100:00100000:0.0:1788658464.164195:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773952 00000100:00100000:0.0:1788658464.164198:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773952 00000100:00100000:0.0:1788658464.164224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788658464.164231:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103773824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.164269:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103773824:12345-0@lo:400:kworker.0 Request processed in 39us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658464.164276:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788658464.164291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788658464.164297:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103773952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.164327:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103773952:12345-0@lo:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658464.164333:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788658464.164350:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774080 00000100:00100000:0.0:1788658464.164353:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774080 00000100:00100000:0.0:1788658464.164377:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658464.164383:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103774080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.164422:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103774080:12345-0@lo:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658464.164429:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788658464.164777:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788658464.164788:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103774208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658464.164830:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103774208:12345-0@lo:400:kworker.0 Request processed in 45us (4033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658464.164837:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788658464.171316:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103773824:0@lo:400:kworker.0 00010000:00080000:0.0:1788658464.171343:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e57005a9500 x1875544103774336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658464.171354:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.171370:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.171432:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.171460:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103773952:0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.171499:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103773696 00000100:00100000:0.0:1788658464.171507:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103773696 00000100:00100000:0.0:1788658464.171583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788658464.171595:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103773696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658464.171720:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103773696:12345-0@lo:400:kworker.0 Request processed in 126us (11127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658464.171727:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788658464.171781:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103773696:0@lo:400:kworker.0 00000100:00080000:0.0:1788658464.172743:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658464.172752:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658464.477060:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658464.670957:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c1302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103774464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658464.671230:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658464.671602:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774464 00000100:00100000:2.0:1788658464.671613:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774464 00000100:00100000:2.0:1788658464.671723:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788658464.671736:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103774464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658464.671805:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658464.671883:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103774464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658464.671892:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788658464.672018:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e55c1302680 x1875544103774464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658464.672041:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c1302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103774464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788658465.501045:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658466.462590:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788658466.525036:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658467.549317:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658468.572911:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658468.765213:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658468.765253:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103774592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658468.765326:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658468.765602:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774592 00000100:00100000:2.0:1788658468.765643:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774592 00000100:00100000:2.0:1788658468.765745:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788658468.765755:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103774592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658468.765792:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658468.765842:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103774592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658468.765849:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788658468.765892:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103774592:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658468.766144:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658469.034027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658469.034077:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658469.034238:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476416 00000100:00100000:1.0:1788658469.034249:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476416 00000100:00100000:1.0:1788658469.034326:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 281 00000100:00100000:1.0:1788658469.034336:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2352:x1875544076476416:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658469.034408:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2352:x1875544076476416:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658469.034415:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 281 00000100:00100000:2.0:1788658469.037599:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476544 00000100:00100000:2.0:1788658469.037616:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476544 00000100:00100000:2.0:1788658469.037805:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:2.0:1788658469.037821:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076476544:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658469.037937:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076476544:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 123us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658469.037946:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00080000:3.0:1788658469.038005:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658469.051967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658469.052074:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476672 00000100:00100000:2.0:1788658469.052085:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476672 00000100:00080000:3.0:1788658469.052242:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658469.052360:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:2.0:1788658469.052371:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2350:x1875544076476672:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:2.0:1788658469.052414:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eac51 00000100:00080000:2.0:1788658469.052424:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9e56c63d9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658469.052487:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788658469.052830:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+2:2350:x1875544076476672:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 459us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658469.052839:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00010000:00010000:3.0:1788658469.052974:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658469.059084:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658469.060134:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476800 00000100:00100000:3.0:1788658469.060146:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476800 00000100:00100000:3.0:1788658469.060250:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:3.0:1788658469.060260:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2352:x1875544076476800:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658469.060337:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2352:x1875544076476800:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 79us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.060345:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00080000:1.0:1788658469.060619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658469.280360:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103774848:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.280430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658469.280504:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103775360:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.280535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658469.280580:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788658469.280586:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103774720:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.280626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658469.280648:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103775232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.280693:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658469.280718:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103775104:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.280752:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658469.280770:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658469.280775:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103774976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.280797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658469.280827:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774848 00000100:00100000:3.0:1788658469.280835:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774848 00000100:00100000:3.0:1788658469.280891:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103775232 00000100:00100000:3.0:1788658469.280894:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103775232 00000100:00100000:3.0:1788658469.280921:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774976 00000100:00100000:3.0:1788658469.280924:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774976 00000100:00100000:3.0:1788658469.280940:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788658469.280948:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103774848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.280999:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103774848:12345-0@lo:400:kworker.0 Request processed in 51us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.281006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788658469.281024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658469.281030:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103775232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.281057:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103775232:12345-0@lo:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.281063:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658469.281075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788658469.281081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103774976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.281111:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103774976:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.281117:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788658469.281135:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103775360 00000100:00100000:3.0:1788658469.281138:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103775360 00000100:00100000:3.0:1788658469.281168:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103775104 00000100:00100000:3.0:1788658469.281171:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103775104 00000100:00100000:3.0:1788658469.281191:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658469.281196:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103775360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.281227:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103775360:12345-0@lo:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.281233:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658469.281244:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658469.281250:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103775104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.281277:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103775104:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.281283:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788658469.281304:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658469.281307:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658469.281333:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103774976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.281345:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103775104:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.281378:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103775232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658469.281388:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103774848:0@lo:400:kworker.0 00010000:00080000:3.0:1788658469.281399:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c2dc3100 x1875544103775360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658469.281409:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103775360:0@lo:400:kworker.0 00000100:00100000:0.0:1788658469.283165:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103774720 00000100:00100000:0.0:1788658469.283185:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103774720 00000100:00100000:0.0:1788658469.283253:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788658469.283262:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103774720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658469.283339:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103774720:12345-0@lo:400:kworker.0 Request processed in 79us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658469.283346:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788658469.284344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103774720:0@lo:400:kworker.0 00000001:00100000:1.0:1788658469.393776:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:1.0:1788658469.393786:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e5700408000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:0.0:1788658469.393863:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5700408000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 for lustre-OST0000 00000020:00000080:0.0:1788658469.393922:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56c63d9000 for lustre-OST0000 00010000:00010000:2.0:1788658469.597381:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658469.789794:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658469.789825:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c1300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103775488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658469.789895:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658469.790056:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103775488 00000100:00100000:2.0:1788658469.790064:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103775488 00000100:00100000:2.0:1788658469.790116:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788658469.790125:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103775488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658469.790172:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658469.790223:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103775488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658469.790230:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788658469.790268:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e55c1300700 x1875544103775488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658469.790286:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c1300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103775488:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788658470.620849:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658471.646393:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658472.671963:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658473.693146:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658473.886504:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103775616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658473.886589:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658473.886774:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103775616 00000100:00100000:1.0:1788658473.886783:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103775616 00000100:00100000:1.0:1788658473.886847:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658473.886856:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103775616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658473.886896:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658473.886946:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103775616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658473.886951:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658473.887061:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103775616:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658473.887190:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658474.153653:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658474.153718:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658474.153759:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658474.153796:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076477184 00000100:00100000:1.0:1788658474.153809:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076477184 00000100:00100000:1.0:1788658474.153880:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076477056 00000100:00100000:1.0:1788658474.153883:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076477056 00000100:00100000:1.0:1788658474.153919:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:1.0:1788658474.153931:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076477184:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658474.154044:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076477184:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 114us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658474.154053:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:1.0:1788658474.154073:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00100000:1.0:1788658474.154080:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076477056:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658474.154105:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076477056:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658474.154111:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00080000:1.0:1788658474.154129:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658474.154274:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076476928 00000100:00100000:0.0:1788658474.154279:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076476928 00000100:00100000:0.0:1788658474.154310:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 283 00000100:00100000:0.0:1788658474.154317:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076476928:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658474.154344:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076476928:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658474.154351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 283 00000100:00100000:3.0:1788658474.398014:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103775872:0@lo:400:kworker.0 00000100:00100000:3.0:1788658474.398110:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658474.398131:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103775744:0@lo:400:kworker.0 00000100:00100000:0.0:1788658474.398792:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103775872 00000100:00100000:0.0:1788658474.398804:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103775872 00000100:00100000:0.0:1788658474.398878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788658474.398890:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103775872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.399160:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103776128:0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.399205:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658474.399264:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658474.399273:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103776000:0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.399299:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658474.399345:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776128 00000100:00100000:2.0:1788658474.399349:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776128 00000100:00100000:2.0:1788658474.399384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776000 00000100:00100000:2.0:1788658474.399387:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776000 00000100:00100000:2.0:1788658474.399401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788658474.399406:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103776128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.399447:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103776128:12345-0@lo:400:kworker.0 Request processed in 40us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658474.399455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788658474.399474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788658474.399479:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103776000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.399508:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103776000:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658474.399514:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788658474.399533:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658474.399563:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658474.399590:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103776256:0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.399615:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658474.399646:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776256 00000100:00100000:2.0:1788658474.399650:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776256 00000100:00100000:2.0:1788658474.400267:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658474.400277:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103776256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.400329:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103776256:12345-0@lo:400:kworker.0 Request processed in 54us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658474.400336:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788658474.400360:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658474.400719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103775744 00000100:00100000:3.0:1788658474.400727:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103775744 00000100:00100000:3.0:1788658474.400765:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788658474.400773:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103775744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658474.400813:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103775744:12345-0@lo:400:kworker.0 Request processed in 41us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658474.400819:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788658474.401188:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103776000:0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.401212:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103776128:0@lo:400:kworker.0 00000100:00100000:2.0:1788658474.401256:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103775744:0@lo:400:kworker.0 00010000:00080000:2.0:1788658474.401271:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56c2dc2a00 x1875544103776256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658474.401282:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103776256:0@lo:400:kworker.0 00000100:00100000:0.0:1788658474.403806:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103775872:12345-0@lo:400:kworker.0 Request processed in 4904us (5682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658474.403826:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788658474.405647:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103775872:0@lo:400:kworker.0 00010000:00010000:3.0:1788658474.718806:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658474.908833:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658474.908855:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103776384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658474.908933:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658474.909003:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776384 00000100:00100000:2.0:1788658474.909012:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776384 00000100:00100000:2.0:1788658474.909062:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658474.909072:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103776384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658474.909125:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658474.909170:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103776384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658474.909178:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788658474.909233:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079c380 x1875544103776384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658474.909270:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103776384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788658475.742385:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658476.701876:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788658476.767158:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658477.618115:0:11853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:34:35 (1788658475) 00010000:00010000:3.0:1788658477.789314:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658478.813369:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658479.005382:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103776512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658479.005470:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658479.006141:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776512 00000100:00100000:1.0:1788658479.006155:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776512 00000100:00100000:1.0:1788658479.006231:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788658479.006242:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103776512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658479.006278:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658479.006332:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103776512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658479.006339:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788658479.006398:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103776512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788658479.006569:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658479.154128:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658479.154343:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076477312 00000100:00100000:2.0:1788658479.154353:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076477312 00000100:00100000:2.0:1788658479.154452:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:2.0:1788658479.154463:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:10253:x1875544076477312:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658479.154482:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788658479.156229:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658479.159022:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650ead1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.159117:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650ead23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.159132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650ead23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.159145:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650ead23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658479.159179:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658479.159183:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658479.159221:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650ead23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.159250:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650ead1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad71 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.159290:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650ead23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad71 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.159299:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658479.159302:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658479.159306:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a600, rc 0) 00000100:00100000:2.0:1788658479.159469:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:10253:x1875544076477312:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 5008us (5350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658479.159478:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:1.0:1788658479.181030:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658479.189094:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076477440 00000100:00100000:2.0:1788658479.189110:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076477440 00000100:00100000:2.0:1788658479.189257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1788658479.189270:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:10254:x1875544076477440:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658479.189289:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658479.189310:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650ead2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad78 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189374:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189389:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189402:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189601:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189622:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189641:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189900:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b000/0xf657f176650ead3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189908:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b000/0xf657f176650ead3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189915:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b000/0xf657f176650ead3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658479.189952:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658479.189956:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658479.189973:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b000/0xf657f176650ead3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189982:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189989:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.189995:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190000:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658479.190004:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190017:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190029:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658479.190032:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658479.190037:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650ead31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190056:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190062:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190068:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190073:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658479.190075:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190081:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190087:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e56d579c600) 00010000:00010000:2.0:1788658479.190089:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658479.190091:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190105:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650ead38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190135:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650ead2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad78 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190147:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b000/0xf657f176650ead3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad78 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658479.190154:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56d579c000) 00010000:00010000:2.0:1788658479.190157:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658479.190159:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b000, rc 0) 00000100:00100000:2.0:1788658479.190227:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:10254:x1875544076477440:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 960us (9207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658479.190234:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:1.0:1788658479.213475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658479.213581:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076477696 00000100:00100000:0.0:1788658479.213605:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076477696 00000100:00100000:0.0:1788658479.213710:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:0.0:1788658479.213731:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:10254:x1875544076477696:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658479.213751:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658479.213772:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650ead46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad7f expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214017:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214032:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214043:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214096:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214104:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214111:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214467:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650ead5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214476:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650ead5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.214483:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650ead5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658479.214498:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788658479.214712:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216019:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216037:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216043:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658479.216048:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216057:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216072:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56d579c000) 00010000:00010000:0.0:1788658479.216075:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658479.216080:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216087:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650ead4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216107:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216114:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216137:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216142:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658479.216145:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216152:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216160:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e56c3c69100) 00010000:00010000:0.0:1788658479.216163:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658479.216166:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.216171:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ead54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.220239:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650ead46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad7f expref: 10 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.220268:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650ead5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad7f expref: 9 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658479.220278:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:0.0:1788658479.220281:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658479.220285:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78000, rc 0) 00000100:00100000:0.0:1788658479.220433:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:10254:x1875544076477696:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 6712us (6964us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788658479.220458:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:0.0:1788658479.240035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658479.240193:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076477824 00000100:00100000:2.0:1788658479.240203:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076477824 00000100:00100000:2.0:1788658479.240260:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:2.0:1788658479.240271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:10254:x1875544076477824:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788658479.240389:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:10254:x1875544076477824:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 Request processed in 120us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658479.240397:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:1.0:1788658479.271098:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658479.271149:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658479.271217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076478080 00000100:00100000:3.0:1788658479.271225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076478080 00000100:00100000:0.0:1788658479.271271:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076477952 00000100:00100000:0.0:1788658479.271275:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076477952 00000100:00100000:3.0:1788658479.271289:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 129 00000100:00100000:0.0:1788658479.271303:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 285 00000100:00100000:0.0:1788658479.271310:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076477952:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658479.271380:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076477952:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658479.271388:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 285 00000100:00080000:1.0:1788658479.271524:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658479.271697:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076478080:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658479.271841:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076478080:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 542us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658479.271849:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 129 00000100:00100000:2.0:1788658479.519522:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103776768:0@lo:400:kworker.0 00000100:00100000:2.0:1788658479.519590:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658479.519642:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658479.519648:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103776896:0@lo:400:kworker.0 00000100:00100000:3.0:1788658479.519779:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103776640:0@lo:400:kworker.0 00000100:00100000:3.0:1788658479.519816:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658479.519842:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103777152:0@lo:400:kworker.0 00000100:00100000:3.0:1788658479.519867:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658479.519968:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658479.519975:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103777024:0@lo:400:kworker.0 00000100:00100000:3.0:1788658479.519998:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658479.520038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776640 00000100:00100000:3.0:1788658479.520047:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776640 00000100:00100000:3.0:1788658479.520089:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788658479.520098:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103776640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658479.520148:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103776640:12345-0@lo:400:kworker.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658479.520617:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658479.520647:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776768 00000100:00100000:2.0:1788658479.520651:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776768 00000100:00100000:2.0:1788658479.521603:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103777024 00000100:00100000:2.0:1788658479.521610:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103777024 00000100:00100000:2.0:1788658479.521642:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103776896 00000100:00100000:2.0:1788658479.521645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103776896 00000100:00100000:2.0:1788658479.522713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788658479.522729:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103776768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658479.522813:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103776768:12345-0@lo:400:kworker.0 Request processed in 90us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658479.522820:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788658479.522842:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788658479.522849:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103777024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658479.522878:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103777024:12345-0@lo:400:kworker.0 Request processed in 30us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658479.522999:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788658479.523040:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103777152 00000100:00100000:3.0:1788658479.523045:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103777152 00000100:00100000:3.0:1788658479.523084:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788658479.523091:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103777152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658479.523126:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103777152:12345-0@lo:400:kworker.0 Request processed in 37us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658479.523132:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788658479.523190:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103777024:0@lo:400:kworker.0 00000100:00100000:3.0:1788658479.523203:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103776640:0@lo:400:kworker.0 00010000:00080000:3.0:1788658479.523215:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570079d500 x1875544103777152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658479.523225:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103777152:0@lo:400:kworker.0 00000100:00100000:2.0:1788658479.523359:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788658479.523375:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788658479.523393:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103776896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658479.523424:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103776896:12345-0@lo:400:kworker.0 Request processed in 33us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658479.523429:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788658479.523497:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103776896:0@lo:400:kworker.0 00000100:00100000:2.0:1788658479.523510:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103776768:0@lo:400:kworker.0 00000100:00080000:1.0:1788658479.523933:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658479.523938:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788658479.595450:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000040:00080000:1.0:1788658479.773245:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788658479.839171:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658480.032472:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103777280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658480.032544:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658480.032619:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103777280 00000100:00100000:1.0:1788658480.032627:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103777280 00000100:00100000:1.0:1788658480.032699:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788658480.032709:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103777280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658480.032745:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658480.032787:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103777280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658480.032794:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788658480.032837:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56ff01f480 x1875544103777280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658480.032854:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103777280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788658480.860991:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658481.031596:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658481.031739:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076478208 00000100:00100000:0.0:1788658481.031749:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076478208 00000100:00100000:0.0:1788658481.031831:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:0.0:1788658481.031843:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:10296:x1875544076478208:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658481.031864:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658481.031886:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650ead69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad86 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.031949:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.031965:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.031978:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.031995:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032009:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032016:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032222:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032231:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032238:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032243:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658481.032248:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032256:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032268:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658481.032271:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658481.032276:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032282:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650ead70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032298:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032310:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032316:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032321:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658481.032324:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032331:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032339:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e56c3c69a00) 00010000:00010000:0.0:1788658481.032342:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658481.032345:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032351:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ead77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032385:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650ead69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad86 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032396:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658481.032398:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658481.032402:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650ead69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad86 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.032412:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79e00, rc 0) 00000100:00100000:0.0:1788658481.032482:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:10296:x1875544076478208:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 641us (893us total) trans 0 rc 301/301 00000100:00100000:0.0:1788658481.032489:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00080000:1.0:1788658481.032762:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658481.039004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.039382:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076478464 00000100:00100000:3.0:1788658481.039393:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076478464 00000100:00100000:3.0:1788658481.039471:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:3.0:1788658481.039483:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:10296:x1875544076478464:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1788658481.039916:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658481.039946:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650ead23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad71 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.039965:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:3.0:1788658481.039978:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658481.040267:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.040281:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.040293:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.040307:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.040314:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.040321:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658481.042217:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788658481.042234:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.042243:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.042249:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.042262:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efe00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658481.042266:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.042275:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.042290:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658481.042294:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658481.042298:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.042304:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650ead7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658481.042327:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1311adb reply state 00000000963feb12 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658481.042336:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658481.042464:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:10296:x1875544076478464:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 2979us (3462us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788658481.042473:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00010000:00010000:2.0:1788658481.046871:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.046900:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.046908:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.046914:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658481.046918:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.046926:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.046942:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e56d0810200) 00010000:00010000:2.0:1788658481.046946:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658481.046951:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.046958:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650ead85 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658481.134229:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658481.136630:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076478592 00000100:00100000:2.0:1788658481.136644:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076478592 00000100:00100000:2.0:1788658481.136740:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:2.0:1788658481.136752:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:10304:x1875544076478592:12345-192.168.202.3@tcp:101:lctl.0 00010000:00010000:2.0:1788658481.136778:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658481.136801:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650ead8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.136893:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ead93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.136908:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ead93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.136919:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ead93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658481.136951:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658481.136954:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658481.136992:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ead93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.137016:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650ead8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad8d expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.137034:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ead93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad8d expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.137043:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658481.137045:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658481.137049:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b600, rc 0) 00000100:00100000:2.0:1788658481.137119:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:10304:x1875544076478592:12345-192.168.202.3@tcp:101:lctl.0 Request processed in 369us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.137126:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:3.0:1788658481.209416:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658481.209655:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076478720 00000100:00100000:0.0:1788658481.210165:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076478720 00000100:00100000:2.0:1788658481.210319:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:2.0:1788658481.210331:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:10310:x1875544076478720:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1788658481.210364:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658481.210387:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650ead9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad94 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.210469:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.210484:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.210496:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.210512:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.210519:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.210526:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211284:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a200/0xf657f176650eadaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211295:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a200/0xf657f176650eadaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211304:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a200/0xf657f176650eadaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658481.211337:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788658481.211350:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658481.211396:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a200/0xf657f176650eadaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211408:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211415:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211422:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211427:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ae00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658481.211776:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211787:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211800:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658481.211803:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658481.211808:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211815:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eada1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211830:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211836:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211853:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211859:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658481.211862:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211868:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211877:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e56d579c700) 00010000:00010000:2.0:1788658481.211879:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658481.211882:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211888:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eada8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211924:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650ead9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad94 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211940:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a200/0xf657f176650eadaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad94 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.211946:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658481.211949:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788658481.211951:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a200, rc 0) 00000100:00100000:2.0:1788658481.212024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:10310:x1875544076478720:12345-192.168.202.3@tcp:101:bash.0 Request processed in 1694us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.212041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:0.0:1788658481.217514:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.223240:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076478976 00000100:00100000:3.0:1788658481.223256:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076478976 00000100:00100000:3.0:1788658481.223395:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:3.0:1788658481.223405:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:10310:x1875544076478976:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658481.223425:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658481.223446:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eadb6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ad9b expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.223595:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.223610:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.223622:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.223689:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.223697:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.223703:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658481.224267:0:11367:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788658481.224432:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224442:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224450:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224483:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224498:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224505:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224511:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658481.224515:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224523:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224535:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658481.224538:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658481.224543:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224549:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eadbd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658481.224564:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf42600 reply state 000000004f979bf4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658481.224573:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788658481.224604:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eadb6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 13 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224619:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 12 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.224636:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:3.0:1788658481.224639:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658481.224641:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eec00, rc 0) 00000100:00100000:3.0:1788658481.224761:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10310:x1875544076478976:12345-192.168.202.3@tcp:101:bash.0 Request processed in 1357us (7255us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788658481.224769:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00010000:00010000:1.0:1788658481.228923:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.228944:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.228952:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.228975:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658481.228980:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.228989:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.229006:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810500) 00010000:00010000:1.0:1788658481.229010:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658481.229014:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.229020:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eadc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658481.244136:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658481.245381:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076479104 00000100:00100000:2.0:1788658481.245393:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076479104 00000100:00100000:2.0:1788658481.245445:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1788658481.245454:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875544076479104:12345-192.168.202.3@tcp:8:bash.0 00010000:00080000:2.0:1788658481.245489:0:10289:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:2.0:1788658481.245525:0:10289:0:(genops.c:1385:class_connect()) connect: client df8d83e3-27bc-4e5d-ab80-c17af5c0fb38, cookie 0xf657f176650eadd9 00002000:00100000:2.0:1788658481.245538:0:10289:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df8d83e3-27bc-4e5d-ab80-c17af5c0fb38/ffff9e56fefa8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658481.245550:0:10289:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658481.245817:0:10289:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788658481.245849:0:10289:0:(import.c:65:import_set_state_nolock()) ffff9e56c6ae8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658481.245921:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2350:x1875544076479104:12345-192.168.202.3@tcp:8:bash.0 Request processed in 466us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.245929:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1788658481.252046:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.252124:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076479232 00000100:00100000:3.0:1788658481.252136:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076479232 00000100:00100000:3.0:1788658481.252231:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:3.0:1788658481.252246:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:0:x1875544076479232:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658481.252266:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658481.252290:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ada2 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658481.252319:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658481.252337:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1788658481.252342:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658481.252351:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.252371:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.252383:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efe00, rc 0) 00000100:00100000:3.0:1788658481.252467:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:0:x1875544076479232:12345-192.168.202.3@tcp:101:bash.0 Request processed in 223us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658481.252485:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00080000:1.0:1788658481.252845:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658481.255059:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658481.255160:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076479360 00000100:00100000:2.0:1788658481.255169:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076479360 00000100:00100000:2.0:1788658481.255239:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:2.0:1788658481.255249:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:10310:x1875544076479360:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1788658481.255267:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658481.255287:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ada9 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.255318:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.255344:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658481.255348:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658481.255354:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.255389:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.255403:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 8 pid: 6685 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658481.255417:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103777408:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658481.255526:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c2891d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658481.259500:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.259623:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076479488 00000100:00100000:3.0:1788658481.259632:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076479488 00010000:00010000:3.0:1788658481.259709:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 9 pid: 6685 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658481.259749:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:3.0:1788658481.259760:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2352:x1875544076479488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658481.259774:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658481.259796:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 9 pid: 6685 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.259808:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 9 pid: 6685 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.259832:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658481.259836:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658481.259843:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.259853:0:7635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.259890:0:7635:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658481.259922:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7635:1875544103777536:192.168.202.3@tcp:105: 00000100:00100000:3.0:1788658481.260003:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9624600 going to sleep for 11 seconds 00010000:00010000:0.0:1788658481.266523:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d2bafd/0xf657f176650eade0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada2 expref: 9 pid: 6685 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658481.266559:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103777408:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658481.266593:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.266608:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891aa00, rc 0) 00000100:00100000:0.0:1788658481.266718:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:10310:x1875544076479360:12345-192.168.202.3@tcp:101:bash.0 Request processed in 11470us (11666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658481.266727:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:3.0:1788658481.271916:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7635:1875544103777536:192.168.202.3@tcp:105: 00010000:00010000:3.0:1788658481.271968:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658481.272063:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076479488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 12302us (12568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658481.272077:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:2.0:1788658481.276845:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658481.277159:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076479744 00000100:00100000:1.0:1788658481.277175:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076479744 00000100:00100000:1.0:1788658481.277265:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1788658481.277277:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:10310:x1875544076479744:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:1.0:1788658481.277642:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10310:x1875544076479744:12345-192.168.202.3@tcp:35:bash.0 Request processed in 367us (813us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788658481.277651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:2.0:1788658481.406869:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658481.407058:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076480000 00000100:00100000:1.0:1788658481.407072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076480000 00000100:00100000:1.0:1788658481.407155:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:1.0:1788658481.407239:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10320:x1875544076480000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658481.407272:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658481.407316:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eadee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658481.407499:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788658481.407722:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eadee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adb0 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.407740:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:1.0:1788658481.407743:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658481.407749:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eadee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adb0 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.407767:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678600, rc 0) 00000100:00100000:1.0:1788658481.407859:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:10320:x1875544076480000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 624us (1008us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788658481.407867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:2.0:1788658481.415438:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.415996:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076480256 00000100:00100000:3.0:1788658481.416012:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076480256 00000100:00100000:3.0:1788658481.423054:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658481.423092:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:10320:x1875544076480256:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1788658481.423459:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:10320:x1875544076480256:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 386us (8033us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788658481.423468:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658481.477141:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658481.477355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076480384 00000100:00100000:2.0:1788658481.477369:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076480384 00000100:00100000:2.0:1788658481.477453:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:2.0:1788658481.477465:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:10326:x1875544076480384:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658481.477497:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658481.477524:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eadfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adb7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.477640:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eae03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.477659:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eae03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.477724:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eae03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658481.477771:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788658481.477775:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658481.477801:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eae03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.477831:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eadfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adb7 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.477854:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eae03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adb7 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.477864:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658481.477867:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658481.477872:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a000, rc 0) 00000100:00100000:2.0:1788658481.478747:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:10326:x1875544076480384:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1273us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.478759:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:2.0:1788658481.484743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.484912:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076480640 00000100:00100000:3.0:1788658481.484927:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076480640 00000100:00100000:3.0:1788658481.485011:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:3.0:1788658481.485025:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:10326:x1875544076480640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658481.485055:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658481.485083:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eae0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adbe expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.485232:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eae11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.485274:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eae11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.485289:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eae11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658481.485305:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788658481.485488:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eae0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adbe expref: 19 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.485511:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eae11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adbe expref: 18 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.485521:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:3.0:1788658481.485524:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658481.485529:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef600, rc 0) 00000100:00100000:3.0:1788658481.485613:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:10326:x1875544076480640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 591us (885us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788658481.485622:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1788658481.492055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658481.493649:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076480896 00000100:00100000:2.0:1788658481.493746:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076480896 00000100:00100000:2.0:1788658481.493844:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:2.0:1788658481.493856:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:10326:x1875544076480896:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658481.493892:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658481.493936:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eae1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adc5 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.494076:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.494095:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.494110:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658481.494124:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788658481.494313:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eae1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adc5 expref: 21 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.494337:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adc5 expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.494347:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:2.0:1788658481.494350:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788658481.494354:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ac00, rc 0) 00000100:00100000:2.0:1788658481.494435:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:10326:x1875544076480896:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 581us (2397us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788658481.494442:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1788658481.495918:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658481.496195:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076481024 00000100:00100000:1.0:1788658481.496208:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076481024 00000100:00100000:1.0:1788658481.496286:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1788658481.496298:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:2354:x1875544076481024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658481.496315:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658481.496347:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eae11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adbe expref: 20 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.496368:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:1.0:1788658481.496374:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658481.496437:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:2354:x1875544076481024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 140us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.496463:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658481.506129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.506284:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076481152 00000100:00100000:3.0:1788658481.506298:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076481152 00000100:00100000:3.0:1788658481.506370:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:3.0:1788658481.506383:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076481152:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1788658481.506447:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.506474:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.506503:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658481.506509:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658481.506515:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.506567:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.506584:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 7 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658481.506603:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875544103777664:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658481.510426:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e5c77600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658481.516633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.516710:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875544103777664:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658481.516745:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658481.517366:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076481280 00000100:00100000:1.0:1788658481.517381:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076481280 00002000:00100000:1.0:1788658481.517449:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e5700d73b80 x1875544076481280/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:72/0 lens 504/0 e 0 to 0 dl 1788658492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658481.517461:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700d73b80 with x1875544076481280 ext(0->12) 00010000:00010000:1.0:1788658481.517472:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 8 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.517490:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 8 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658481.517498:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5700d73b80 00000100:00100000:1.0:1788658481.517540:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1788658481.517552:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2353:x1875544076481280:12345-192.168.202.3@tcp:4:lfs.0 00000001:00100000:3.0:1788658481.621255:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000100:00100000:0.0:1788658481.622272:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2353:x1875544076481280:12345-192.168.202.3@tcp:4:lfs.0 Request processed in 104710us (105647us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788658481.622299:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00002000:00100000:0.0:1788658481.622317:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e5700d73b80 x1875544076481280/t4294967299(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:72/0 lens 504/448 e 0 to 0 dl 1788658492 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658481.622328:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700d73b80 with x1875544076481280 ext(0->12) 00010000:00010000:0.0:1788658481.622341:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.622363:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658481.622372:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5700d73b80 00000100:00100000:1.0:1788658481.638935:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658481.639067:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076481408 00000100:00100000:0.0:1788658481.639088:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076481408 00010000:00010000:0.0:1788658481.639236:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658481.639295:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:0.0:1788658481.639308:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2354:x1875544076481408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658481.639330:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788658481.639359:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788658481.639362:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788658480 00002000:00010000:0.0:1788658481.639364:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788658481 00002000:00010000:0.0:1788658481.639367:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788658480 00010000:00010000:0.0:1788658481.639374:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.639418:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.639451:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650eade7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ada9 expref: 9 pid: 6687 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.639472:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658481.639477:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658481.639484:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.639496:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.639535:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658481.639618:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2354:x1875544076481408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 311us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658481.639629:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00010000:00010000:3.0:1788658481.639643:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639661:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639755:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639764:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639772:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639779:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658481.639784:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639794:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639813:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.639821:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650eae34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658481.639907:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076481152:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 133523us (133790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658481.639928:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:2.0:1788658481.644868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658481.645116:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076481664 00000100:00100000:0.0:1788658481.645207:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076481664 00000100:00100000:0.0:1788658481.645292:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658481.645305:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:10326:x1875544076481664:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:0.0:1788658481.645386:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adc5 expref: 19 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658481.648452:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788658481.648578:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788658481.649454:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788658481.649532:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.649558:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 23 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.649570:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.649623:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 23 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.649643:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 23 pid: 11367 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658481.649661:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875544103777792:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658481.649846:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658481.653042:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875544103777792:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658481.653076:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658481.654060:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658481.654167:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076481792 00000100:00100000:1.0:1788658481.654180:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076481792 00010000:00010000:1.0:1788658481.654226:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 24 pid: 11367 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658481.654418:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:1.0:1788658481.654429:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:2352:x1875544076481792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658481.654444:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658481.654451:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 24 pid: 11367 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.654478:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 24 pid: 11367 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.654500:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eadcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad9b expref: 24 pid: 11367 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.654532:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:1.0:1788658481.654537:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.654545:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.654553:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.654587:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658481.654741:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:2352:x1875544076481792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 313us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.654748:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00010000:00010000:2.0:1788658481.655338:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.655354:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658481.655550:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788658481.655873:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788658481.656203:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d72a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103777920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788658481.656371:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658481.656413:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658481.656706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103777920 00000100:00100000:0.0:1788658481.656715:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103777920 00000100:00100000:0.0:1788658481.656774:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658481.656784:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875544103777920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788658481.656879:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875544103777920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658481.656887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658481.657027:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d72a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103777920:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788658481.657252:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788658481.658164:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788658481.658254:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103778048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788658481.658306:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658481.658419:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c2891e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658481.658585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103778048 00000100:00100000:0.0:1788658481.658595:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103778048 00000100:00100000:3.0:1788658481.658853:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658481.658864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875544103778048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788658481.659211:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875544103778048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 348us (903us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788658481.659218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658481.659307:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103778048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788658481.659365:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788658481.659406:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.659416:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.659423:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.659429:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658481.659434:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.659454:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.659472:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:0.0:1788658481.659476:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788658481.659481:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.659487:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eae3b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658481.659733:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788658481.660109:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788658481.660121:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372799455816ns, next at 373799453753ns, rc = 0 00000001:00080000:0.0:1788658481.660128:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788658481.660173:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:0.0:1788658481.660177:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788658481.660186:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adc5 expref: 27 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658481.660284:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:10326:x1875544076481664:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 14982us (15433us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788658481.660293:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000020:00080000:0.0:1788658481.660297:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788658481.662867:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.663007:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076481920 00000100:00100000:3.0:1788658481.663021:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076481920 00000100:00100000:3.0:1788658481.663182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1788658481.663193:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:10326:x1875544076481920:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658481.663217:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658481.663242:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eae42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adcc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.663302:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eae42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adcc expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.663317:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eae42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adcc expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.663334:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658481.663349:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658481.663353:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef000, rc 0) 00000100:00100000:3.0:1788658481.663417:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:10326:x1875544076481920:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 226us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658481.663424:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1788658481.666758:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658481.666891:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076482176 00000100:00100000:2.0:1788658481.666900:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076482176 00000100:00100000:2.0:1788658481.666972:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1788658481.666982:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:10326:x1875544076482176:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1788658481.667235:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:10326:x1875544076482176:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 253us (487us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788658481.667242:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1788658481.779830:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658481.780034:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076482432 00000100:00100000:1.0:1788658481.780045:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076482432 00000100:00100000:1.0:1788658481.780101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:1.0:1788658481.780108:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:10336:x1875544076482432:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658481.780141:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658481.780167:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eae49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8add3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658481.780274:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788658481.780398:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eae49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8add3 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.780805:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:1.0:1788658481.780809:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658481.780815:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eae49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8add3 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658481.780829:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679600, rc 0) 00000100:00100000:1.0:1788658481.780886:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10336:x1875544076482432:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 778us (1068us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788658481.780893:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:1.0:1788658481.786567:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658481.786791:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076482560 00000100:00100000:2.0:1788658481.786801:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076482560 00000100:00100000:2.0:1788658481.786914:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:2.0:1788658481.786924:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10336:x1875544076482560:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:2.0:1788658481.787004:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787039:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787050:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787066:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787073:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787079:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787174:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787183:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787189:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658481.787241:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787255:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787261:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787280:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787286:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658481.787290:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787299:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787311:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658481.787315:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658481.787320:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787327:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eae57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787341:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787348:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787354:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787359:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658481.787362:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787378:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787387:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d579c700) 00010000:00010000:2.0:1788658481.787389:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658481.787392:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787398:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787412:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787419:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787424:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787440:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658481.787443:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787448:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787455:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658481.787457:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658481.787460:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658481.787475:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658481.787564:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10336:x1875544076482560:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 641us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.787572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:0.0:1788658481.790610:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.790864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076482816 00000100:00100000:3.0:1788658481.790874:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076482816 00000100:00100000:3.0:1788658481.791085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1788658481.791097:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10336:x1875544076482816:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1788658481.791367:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+30:10336:x1875544076482816:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 271us (765us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788658481.791375:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:0.0:1788658481.833334:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.833412:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076483072 00000100:00100000:3.0:1788658481.833435:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076483072 00000100:00100000:3.0:1788658481.833561:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:3.0:1788658481.833574:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+30:10339:x1875544076483072:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658481.833601:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658481.833623:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833715:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833729:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833740:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833766:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833774:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833780:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833889:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833898:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.833905:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658481.833914:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788658481.834011:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834019:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834027:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834033:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658481.834037:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834055:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834067:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658481.834070:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658481.834075:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834081:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eae73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834095:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834100:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834105:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834110:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658481.834147:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834154:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834163:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810f00) 00010000:00010000:3.0:1788658481.834165:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658481.834167:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834178:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eae7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834213:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834221:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.834226:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658481.834228:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658481.834230:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eee00, rc 0) 00000100:00100000:3.0:1788658481.834289:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:10339:x1875544076483072:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 719us (967us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788658481.834297:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:1.0:1788658481.841184:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.841269:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076483200 00000100:00100000:3.0:1788658481.841279:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076483200 00000100:00100000:3.0:1788658481.841345:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:3.0:1788658481.841356:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:10339:x1875544076483200:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:3.0:1788658481.841438:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841455:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841467:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841520:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841528:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841535:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841541:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658481.841546:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841555:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841567:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658481.841570:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658481.841575:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658481.841581:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eae8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658481.841661:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:10339:x1875544076483200:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 307us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658481.841703:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1788658481.844737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658481.844787:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076483456 00000100:00100000:3.0:1788658481.844798:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076483456 00000100:00100000:0.0:1788658481.844937:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1788658481.844950:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:10339:x1875544076483456:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658481.845194:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:10339:x1875544076483456:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 247us (473us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788658481.845201:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00010000:00010000:2.0:1788658481.885094:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658482.099165:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.099355:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076483712 00000100:00100000:2.0:1788658482.099366:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076483712 00000100:00100000:2.0:1788658482.099695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:2.0:1788658482.099716:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:10371:x1875544076483712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1788658482.099745:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658482.099767:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ade1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.099869:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.099886:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.099899:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658482.099911:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788658482.100077:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eae96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade1 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.100109:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade1 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.100132:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.100135:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658482.100139:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891aa00, rc 0) 00000100:00100000:2.0:1788658482.100661:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10371:x1875544076483712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 955us (1504us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788658482.100729:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:1.0:1788658482.105170:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.106072:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076483968 00000100:00100000:2.0:1788658482.106093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076483968 00000100:00100000:2.0:1788658482.106216:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1788658482.106227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10371:x1875544076483968:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1788658482.107322:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658482.107482:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076484096 00000100:00100000:3.0:1788658482.107503:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076484096 00000100:00100000:3.0:1788658482.107557:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:3.0:1788658482.107566:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:2354:x1875544076484096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658482.107578:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658482.107602:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eae9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade1 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.107620:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658482.107625:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658482.107681:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+36:2354:x1875544076484096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658482.107688:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:2.0:1788658482.108015:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10371:x1875544076483968:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1788us (2854us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788658482.108022:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1788658482.161518:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658482.161611:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076484352 00000100:00100000:3.0:1788658482.161621:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076484352 00000100:00100000:3.0:1788658482.161711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:3.0:1788658482.161722:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10377:x1875544076484352:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:3.0:1788658482.161747:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658482.161750:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788658482.161775:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eae03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adb7 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.161795:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658482.161800:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658482.161813:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eaeab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ade8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.161905:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.161930:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.161938:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.161970:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.161982:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 35 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658482.161995:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103778176:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658482.162090:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c550b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658482.165550:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.165710:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103778176:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658482.165737:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658482.165954:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076484480 00000100:00100000:0.0:1788658482.165961:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076484480 00010000:00010000:0.0:1788658482.165998:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 36 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658482.166059:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:0.0:1788658482.166069:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+36:2352:x1875544076484480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658482.166095:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658482.166102:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 36 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.166113:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 36 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.166136:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eae81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adda expref: 36 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.166150:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:0.0:1788658482.166155:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.166164:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.166171:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.166199:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658482.166251:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:2352:x1875544076484480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 183us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658482.166258:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00010000:00010000:2.0:1788658482.166359:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.166367:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658482.166386:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788658482.166590:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eaeab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.166616:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.166624:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.166627:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658482.166629:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:2.0:1788658482.166655:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10377:x1875544076484352:12345-192.168.202.3@tcp:101:dd.0 Request processed in 4936us (5166us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788658482.166693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:0.0:1788658482.170429:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.170639:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076484736 00000100:00100000:2.0:1788658482.170649:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076484736 00000100:00100000:2.0:1788658482.170912:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:2.0:1788658482.170923:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10377:x1875544076484736:12345-192.168.202.3@tcp:36:dd.0 00010000:00010000:2.0:1788658482.171217:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.171237:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.171249:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658482.171434:0:11367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788658482.171460:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c885591f reply state 00000000f89be72a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.171468:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658482.171706:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:10377:x1875544076484736:12345-192.168.202.3@tcp:36:dd.0 Request processed in 783us (1283us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788658482.171713:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000020:00080000:2.0:1788658482.171718:0:11367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788658482.172974:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.172989:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.172996:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.173002:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658482.173006:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.173013:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.173040:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658482.173042:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658482.173047:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.173053:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eaec0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658482.390265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.390449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076484864 00000100:00100000:2.0:1788658482.390458:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076484864 00000100:00100000:2.0:1788658482.390754:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:2.0:1788658482.390765:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:10391:x1875544076484864:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:2.0:1788658482.390794:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658482.390816:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaec7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391269:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391284:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391297:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391315:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391323:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391330:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391426:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391451:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391459:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391493:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.391520:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 38 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.391533:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103778304:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658482.392038:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5d9c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658482.394382:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.394574:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103778304:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658482.394601:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658482.394898:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076485120 00000100:00100000:0.0:1788658482.394906:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076485120 00000100:00100000:0.0:1788658482.394967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:0.0:1788658482.394977:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:5589:x1875544076485120:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788658482.395514:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:5589:x1875544076485120:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 524us (1136us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788658482.395523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658482.398697:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658482.398785:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076485248 00000100:00100000:3.0:1788658482.398795:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076485248 00010000:00010000:3.0:1788658482.398906:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 40 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658482.398979:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1788658482.398990:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:2354:x1875544076485248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658482.399006:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658482.399012:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 40 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.399057:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 40 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.399081:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaeb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ade8 expref: 40 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.399097:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658482.399116:0:7635:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.399127:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.399135:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.399171:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658482.399224:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:2354:x1875544076485248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 235us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658482.399232:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00010000:00010000:2.0:1788658482.399441:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399450:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658482.399495:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788658482.399500:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658482.399552:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399576:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399586:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399592:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399598:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399603:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.399606:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399613:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399622:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658482.399625:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.399629:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399634:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaece lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399645:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399651:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399662:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399709:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.399712:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399719:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399728:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d579c700) 00010000:00010000:2.0:1788658482.399731:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.399734:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399740:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399777:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaec7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adef expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399791:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adef expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.399798:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.399800:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658482.399803:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b200, rc 0) 00000100:00100000:2.0:1788658482.399843:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:10391:x1875544076484864:12345-192.168.202.3@tcp:101:stat.0 Request processed in 9080us (9588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658482.399859:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:1.0:1788658482.452921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.453014:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076485504 00000100:00100000:2.0:1788658482.453024:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076485504 00000100:00100000:2.0:1788658482.453089:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:2.0:1788658482.453098:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:10397:x1875544076485504:12345-192.168.202.3@tcp:36:truncate.0 00010000:00010000:2.0:1788658482.453151:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658482.453176:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaedc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adef expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.453196:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.453200:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658482.453416:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.453431:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.453440:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658482.453491:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788658482.453528:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4c12fbd reply state 00000000a0b7cd0e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.453536:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658482.453847:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:10397:x1875544076485504:12345-192.168.202.3@tcp:36:truncate.0 Request processed in 747us (932us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788658482.453854:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00000020:00080000:2.0:1788658482.453859:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788658482.459747:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.459765:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.459773:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.459793:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658482.459799:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.459806:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.459834:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:1.0:1788658482.459838:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658482.459842:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.459848:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eaee3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658482.586719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.586815:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076485632 00000100:00100000:2.0:1788658482.586823:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076485632 00000100:00100000:2.0:1788658482.586871:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:2.0:1788658482.586878:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:10411:x1875544076485632:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:2.0:1788658482.586898:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658482.586915:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaeea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adf6 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.586968:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.586979:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.586987:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.586996:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587001:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587005:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587097:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587105:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587129:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658482.587165:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788658482.587169:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658482.587190:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587202:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587209:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587214:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587220:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587225:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.587228:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587236:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587247:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658482.587250:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.587254:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587270:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaef1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587285:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587291:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587297:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587301:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.587304:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587309:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587316:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d579c700) 00010000:00010000:2.0:1788658482.587318:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.587321:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587326:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587472:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaeea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 41 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587496:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 40 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.587503:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.587506:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658482.587508:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891bc00, rc 0) 00000100:00100000:2.0:1788658482.587612:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:10411:x1875544076485632:12345-192.168.202.3@tcp:101:stat.0 Request processed in 734us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658482.587620:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:2.0:1788658482.661299:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658482.661468:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076485888 00000100:00100000:1.0:1788658482.661478:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076485888 00000100:00100000:1.0:1788658482.661537:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:1.0:1788658482.661547:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:10421:x1875544076485888:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658482.661567:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658482.661586:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eaf06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8adfd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658482.661702:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788658482.661822:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eaf06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adfd expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.661837:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:1.0:1788658482.661852:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658482.661858:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eaf06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adfd expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.661873:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679200, rc 0) 00000100:00100000:1.0:1788658482.661942:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+41:10421:x1875544076485888:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 396us (654us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788658482.661949:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:1.0:1788658482.665593:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658482.665755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076486144 00000100:00100000:0.0:1788658482.665764:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076486144 00000100:00100000:0.0:1788658482.665823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:0.0:1788658482.665832:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+41:10421:x1875544076486144:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658482.666070:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+42:10421:x1875544076486144:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 238us (485us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788658482.666078:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:0.0:1788658482.732908:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658482.733068:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076486400 00000100:00100000:1.0:1788658482.733080:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076486400 00000100:00100000:1.0:1788658482.733146:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:1.0:1788658482.733156:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+42:10427:x1875544076486400:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1788658482.733180:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658482.733201:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eaf14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae04 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.733304:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.733320:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 43 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.733329:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.733364:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 43 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.733401:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 43 pid: 11367 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658482.733416:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fabd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103778432:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658482.733526:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658482.741552:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fabd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103778432:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658482.741583:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658482.742206:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.743996:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076486528 00000100:00100000:2.0:1788658482.744021:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076486528 00010000:00010000:2.0:1788658482.747404:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 44 pid: 11367 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.747463:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1788658482.747482:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+44:2351:x1875544076486528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658482.747496:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658482.747503:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 44 pid: 11367 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.747541:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 44 pid: 11367 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.747564:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaeff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adf6 expref: 44 pid: 11367 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.747582:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.747587:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.747595:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.747604:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.747737:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658482.747852:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:2351:x1875544076486528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 378us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658482.747859:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00010000:00010000:0.0:1788658482.749175:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.749186:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658482.749206:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788658482.749355:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eaf14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 44 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.749372:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 43 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.749399:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:0.0:1788658482.749403:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658482.749405:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679800, rc 0) 00000100:00100000:0.0:1788658482.749456:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:10427:x1875544076486400:12345-192.168.202.3@tcp:101:bash.0 Request processed in 16300us (16556us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788658482.749464:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1788658482.756273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.756364:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076486784 00000100:00100000:2.0:1788658482.756375:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076486784 00000100:00100000:2.0:1788658482.756484:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:2.0:1788658482.756493:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:10427:x1875544076486784:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:2.0:1788658482.756761:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.756779:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.756803:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658482.756857:0:11367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788658482.756886:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa10c35d reply state 00000000f27b2f54 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.756892:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658482.756969:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+46:10427:x1875544076486784:12345-192.168.202.3@tcp:36:bash.0 Request processed in 478us (705us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788658482.756974:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000020:00080000:2.0:1788658482.756978:0:11367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788658482.763485:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.763501:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.763508:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.763514:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891bc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.763519:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.763528:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.763544:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.763547:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.763563:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.763570:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658482.763758:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.764470:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076486912 00000100:00100000:2.0:1788658482.764480:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076486912 00000100:00100000:2.0:1788658482.764529:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:2.0:1788658482.764538:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:10427:x1875544076486912:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1788658482.764560:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658482.764577:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae0b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.764687:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.764700:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 46 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.764709:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.764739:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 46 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.764750:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 46 pid: 6710 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.764763:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d71880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103778560:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658482.764859:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cb171240 going to sleep for 11 seconds 00000100:00100000:3.0:1788658482.771793:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658482.772028:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076487040 00000100:00100000:1.0:1788658482.772039:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076487040 00010000:00010000:1.0:1788658482.772080:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 47 pid: 6710 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658482.772122:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:1.0:1788658482.772132:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:2352:x1875544076487040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658482.772148:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658482.772155:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 47 pid: 6710 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.772167:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 47 pid: 6710 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.772189:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:1.0:1788658482.772194:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.772203:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.772229:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658482.772250:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658482.772307:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:2352:x1875544076487040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 175us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658482.772325:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00010000:00010000:2.0:1788658482.774278:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eaf1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae04 expref: 46 pid: 6710 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.774303:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d71880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103778560:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658482.774338:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.774347:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.774352:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658482.774399:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788658482.774404:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658482.774427:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.774461:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae0b expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.774477:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae0b expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.774486:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.774489:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658482.774493:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b400, rc 0) 00000100:00100000:2.0:1788658482.774575:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:10427:x1875544076486912:12345-192.168.202.3@tcp:101:bash.0 Request processed in 10031us (10814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658482.774596:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:3.0:1788658482.778098:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658482.778165:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076487296 00000100:00100000:0.0:1788658482.778175:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076487296 00000100:00100000:0.0:1788658482.778395:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:0.0:1788658482.778406:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:10427:x1875544076487296:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:0.0:1788658482.778719:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+46:10427:x1875544076487296:12345-192.168.202.3@tcp:35:bash.0 Request processed in 313us (626us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788658482.778727:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:1.0:1788658482.862801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658482.863193:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076487552 00000100:00100000:0.0:1788658482.863203:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076487552 00000100:00100000:0.0:1788658482.863259:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1788658482.863279:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+46:10437:x1875544076487552:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658482.863305:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658482.863584:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eaf3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae12 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658482.863726:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788658482.864280:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eaf3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae12 expref: 48 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.864591:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:0.0:1788658482.864594:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658482.864601:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eaf3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae12 expref: 48 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658482.864617:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:1.0:1788658482.864819:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:10437:x1875544076487552:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1549us (2025us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788658482.864832:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:1.0:1788658482.869602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.869704:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076487680 00000100:00100000:2.0:1788658482.869714:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076487680 00000100:00100000:2.0:1788658482.869773:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1788658482.869783:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:10437:x1875544076487680:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:2.0:1788658482.869869:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.869886:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.869899:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.869915:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.869921:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.869927:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870027:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870037:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870044:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658482.870109:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870123:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870130:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870138:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870144:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.870149:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870156:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870169:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658482.870173:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.870177:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870185:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870198:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870205:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870218:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870223:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891bc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.870227:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870234:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870242:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d579c700) 00010000:00010000:2.0:1788658482.870244:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.870247:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870253:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870269:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870276:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870281:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870286:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ae00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.870289:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870564:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870574:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.870577:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658482.870581:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.870586:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.870727:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:10437:x1875544076487680:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 943us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658482.870735:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:1.0:1788658482.875140:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.875238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076487936 00000100:00100000:2.0:1788658482.875248:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076487936 00000100:00100000:2.0:1788658482.875713:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1788658482.875726:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:10437:x1875544076487936:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1788658482.876106:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:10437:x1875544076487936:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 383us (974us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788658482.876114:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00010000:00010000:2.0:1788658482.914307:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658482.924783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658482.925039:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076488192 00000100:00100000:2.0:1788658482.925049:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076488192 00000100:00100000:2.0:1788658482.925121:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:2.0:1788658482.925132:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:10440:x1875544076488192:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658482.925156:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658482.925185:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae19 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.925257:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.925286:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.925950:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926188:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926199:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926207:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926466:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eaf76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926476:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eaf76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926483:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eaf76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658482.926602:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788658482.926726:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926735:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926741:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926747:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891bc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658482.926751:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926758:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926771:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658482.926774:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658482.926779:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926785:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eaf68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926799:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926805:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926820:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926825:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658482.926827:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926833:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926840:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810f00) 00010000:00010000:3.0:1788658482.926911:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658482.926917:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.926922:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eaf6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.928277:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eaf61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae19 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.928309:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eaf76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae19 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.928317:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658482.928320:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658482.928323:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef400, rc 0) 00000100:00100000:3.0:1788658482.928401:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:10440:x1875544076488192:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3271us (3627us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788658482.928425:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:0.0:1788658482.934982:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658482.935039:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658482.935587:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076488448 00000100:00100000:3.0:1788658482.935599:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076488448 00000100:00100000:3.0:1788658482.936040:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658482.936050:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:2353:x1875544076488448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658482.936063:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658482.936086:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eaf76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae19 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658482.936105:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658482.936109:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658482.936166:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+49:2353:x1875544076488448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658482.936173:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1788658482.937155:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076488320 00000100:00100000:2.0:1788658482.937164:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076488320 00000100:00100000:2.0:1788658482.937209:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:2.0:1788658482.937217:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+49:10440:x1875544076488320:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1788658482.937279:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937305:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937317:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937342:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937349:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937355:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937376:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658482.937380:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937389:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937399:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658482.937401:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658482.937406:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658482.937412:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658482.937480:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+49:10440:x1875544076488320:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 264us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658482.937486:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:2.0:1788658482.948865:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658482.950723:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076488704 00000100:00100000:0.0:1788658482.950738:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076488704 00000100:00100000:0.0:1788658482.951001:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1788658482.951014:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+49:10440:x1875544076488704:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658482.951252:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:10440:x1875544076488704:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 241us (2397us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788658482.951259:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1788658483.090768:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658483.090986:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076488960 00000100:00100000:2.0:1788658483.090998:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076488960 00000100:00100000:2.0:1788658483.091191:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:2.0:1788658483.091202:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:10458:x1875544076488960:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1788658483.091224:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658483.091247:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae20 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.091344:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaf92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.091387:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaf92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.091399:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaf92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658483.091412:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788658483.091546:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eaf8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae20 expref: 53 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.091566:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaf92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae20 expref: 52 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.091574:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:2.0:1788658483.091577:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788658483.091581:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b200, rc 0) 00000100:00100000:2.0:1788658483.092170:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10458:x1875544076488960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 967us (1408us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788658483.092178:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00080000:1.0:1788658483.094587:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658483.114889:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.115107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076489088 00000100:00100000:3.0:1788658483.115117:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076489088 00000100:00100000:3.0:1788658483.115229:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:3.0:1788658483.115240:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10459:x1875544076489088:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658483.115264:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658483.115298:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae27 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.115371:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eafa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.115386:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eafa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.115413:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eafa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658483.115447:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788658483.115451:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658483.115468:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eafa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.115494:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae27 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.115528:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eafa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae27 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.115537:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658483.115540:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658483.115544:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658483.115608:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10459:x1875544076489088:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 369us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658483.115614:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:2.0:1788658483.120337:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.120453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076489472 00000100:00100000:3.0:1788658483.120463:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076489472 00000100:00100000:0.0:1788658483.120945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1788658483.120955:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10459:x1875544076489472:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658483.121264:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10459:x1875544076489472:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 311us (934us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788658483.121269:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1788658483.123455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658483.123631:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076489600 00000100:00100000:1.0:1788658483.123641:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076489600 00000100:00100000:1.0:1788658483.123864:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658483.123875:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10459:x1875544076489600:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:1.0:1788658483.123890:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788658483.123914:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eaf37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae0b expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.123935:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eaf92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae20 expref: 53 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.123981:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eae42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8adcc expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.123994:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:1.0:1788658483.124003:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658483.124062:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10459:x1875544076489600:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 189us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658483.124070:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658483.125867:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.125950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076489728 00000100:00100000:3.0:1788658483.125958:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076489728 00000100:00100000:3.0:1788658483.126015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:3.0:1788658483.126022:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10459:x1875544076489728:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:3.0:1788658483.126120:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.126135:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.126144:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658483.126611:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658483.126944:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788658483.127015:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788658483.127109:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10459:x1875544076489728:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 1085us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658483.127118:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:2.0:1788658483.139484:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.139562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076489856 00000100:00100000:3.0:1788658483.139573:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076489856 00000100:00100000:3.0:1788658483.139708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 67 00000100:00100000:3.0:1788658483.139720:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10461:x1875544076489856:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658483.139739:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658483.139763:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eafb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139813:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139824:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139836:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139867:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139875:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139882:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139945:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139951:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.139955:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658483.139996:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788658483.140000:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658483.140018:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140095:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140103:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140110:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140129:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140134:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eea00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658483.140138:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140145:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140156:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658483.140159:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658483.140163:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140168:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eafbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140181:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140186:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140191:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140195:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658483.140198:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140212:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140219:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810e00) 00010000:00010000:3.0:1788658483.140221:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658483.140224:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140229:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140256:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eafb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140459:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.140466:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:3.0:1788658483.140467:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658483.140469:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efc00, rc 0) 00000100:00100000:3.0:1788658483.140568:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10461:x1875544076489856:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 850us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658483.140575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 67 00000040:00080000:1.0:1788658483.878557:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658483.878566:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658483.879332:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788658483.879343:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658483.879469:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103778688:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658483.880310:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658483.895623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.895655:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076489984 00000100:00100000:3.0:1788658483.895679:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076489984 00000100:00100000:3.0:1788658483.895722:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:3.0:1788658483.895731:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076489984:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788658483.895813:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076489984:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658483.895821:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000040:00080000:0.0:1788658483.895855:0:12003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658483.895860:0:12003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658483.895914:0:12003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788658483.895922:0:12003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658483.897781:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103778688:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658483.899808:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658483.902629:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076490112 00000100:00100000:2.0:1788658483.902642:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076490112 00000100:00100000:2.0:1788658483.902727:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:2.0:1788658483.902738:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10472:x1875544076490112:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658483.902769:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658483.902899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10472:x1875544076490112:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 163us (3098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658483.902917:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:3.0:1788658483.908292:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658483.908368:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076490240 00000100:00100000:1.0:1788658483.908377:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076490240 00000100:00100000:1.0:1788658483.908432:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:1.0:1788658483.908443:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10472:x1875544076490240:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788658483.908515:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908531:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908551:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908606:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908614:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908620:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908646:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908655:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908683:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658483.908720:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788658483.908724:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658483.908740:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908752:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908759:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908776:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908781:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658483.908786:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908794:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908806:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:1.0:1788658483.908809:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658483.908813:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908820:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eafd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908830:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908835:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908840:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908844:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658483.908848:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908863:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908871:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9e56c3c59900) 00010000:00010000:1.0:1788658483.908873:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658483.908887:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908893:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eafd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908908:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908915:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908920:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908925:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658483.908928:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908933:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908940:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:1.0:1788658483.908942:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658483.908945:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.908961:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eafdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658483.909035:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10472:x1875544076490240:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 594us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658483.909043:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1788658483.923488:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.923539:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076490496 00000100:00100000:3.0:1788658483.923548:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076490496 00000100:00100000:3.0:1788658483.923598:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:3.0:1788658483.923608:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:10472:x1875544076490496:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658483.923627:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658483.923646:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eafe6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae35 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923776:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923790:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923800:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658483.923811:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788658483.923918:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923925:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923940:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923945:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658483.923949:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923956:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923967:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:3.0:1788658483.923970:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658483.923975:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.923981:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eafed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.924021:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eafe6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae35 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.924031:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:3.0:1788658483.924033:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658483.924037:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eafe6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae35 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.924045:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee400, rc 0) 00000100:00100000:3.0:1788658483.924122:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076490496:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 515us (644us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788658483.924138:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 70 00010000:00010000:2.0:1788658483.933849:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658483.933942:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658483.934038:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076490624 00000100:00100000:2.0:1788658483.934048:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076490624 00000100:00100000:2.0:1788658483.934106:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:2.0:1788658483.934115:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076490624:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658483.934148:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658483.934256:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076490624:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 141us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658483.934263:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:0.0:1788658483.949506:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658483.949593:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076490880 00000100:00100000:2.0:1788658483.949602:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076490880 00000100:00100000:2.0:1788658483.949661:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:2.0:1788658483.949693:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076490880:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658483.949714:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658483.949718:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788658483.949744:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eafa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae27 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.949763:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658483.949769:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658483.949781:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eaffb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae3c expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658483.950161:0:6710:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788658483.950348:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.952067:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.952081:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.952171:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eaffb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae3c expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.952190:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae3c expref: 54 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.952198:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:2.0:1788658483.952201:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658483.952205:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891be00, rc 0) 00000100:00100000:2.0:1788658483.952318:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10472:x1875544076490880:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 2625us (2819us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788658483.952327:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:0.0:1788658483.956330:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.956442:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076491136 00000100:00100000:3.0:1788658483.956450:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076491136 00000100:00100000:3.0:1788658483.956509:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:3.0:1788658483.956519:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10472:x1875544076491136:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658483.956574:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658483.956599:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae3c expref: 54 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956616:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:3.0:1788658483.956626:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658483.956645:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956694:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956705:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956719:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956726:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956733:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956806:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956813:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956820:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956826:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658483.956830:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956838:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956847:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658483.956850:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658483.956854:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956860:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb010 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956878:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956885:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956892:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956903:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658483.956907:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956913:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956921:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x23518525 (ffff9e56d0810e00) 00010000:00010000:3.0:1788658483.956923:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658483.956926:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658483.956932:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb017 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x23518525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658483.957002:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076491136:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 484us (680us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658483.957009:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:3.0:1788658483.958658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658483.959824:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076491264 00000100:00100000:0.0:1788658483.959837:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076491264 00000100:00100000:0.0:1788658483.959906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:0.0:1788658483.959916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10472:x1875544076491264:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658483.959934:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658483.959954:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb01e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae43 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658483.959987:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658483.960001:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658483.960013:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658483.960099:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb01e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658483.960115:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658483.960124:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658483.960132:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658483.960136:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78a00, rc 0) 00000100:00100000:0.0:1788658483.960188:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10472:x1875544076491264:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 273us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658483.960195:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:0.0:1788658483.965098:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658483.965162:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076491520 00000100:00100000:2.0:1788658483.965170:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076491520 00000100:00100000:2.0:1788658483.965219:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:2.0:1788658483.965229:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10472:x1875544076491520:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658483.965300:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.965317:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.965356:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658483.965602:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1788658483.965611:0:6710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375104945351ns, next at 376104942551ns, rc = 0 00000004:00010000:2.0:1788658483.965721:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f263dd6 reply state 000000006d7cff5f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658483.965730:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658483.965811:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10472:x1875544076491520:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 583us (721us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788658483.965818:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:0.0:1788658483.978368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658483.978451:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076491648 00000100:00100000:2.0:1788658483.978461:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076491648 00000100:00100000:2.0:1788658483.978523:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:2.0:1788658483.978533:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10472:x1875544076491648:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658483.978559:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658483.978579:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.978641:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.978683:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658483.978705:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658483.978716:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658483.978721:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a600, rc 0) 00000100:00100000:2.0:1788658483.978771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10472:x1875544076491648:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 239us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658483.978778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00010000:00010000:1.0:1788658483.979442:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.979453:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.979460:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.979466:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658483.979470:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.979478:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.979490:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:1.0:1788658483.979493:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788658483.979497:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658483.979504:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb02c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658483.981154:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.981218:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076491776 00000100:00100000:3.0:1788658483.981225:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076491776 00000100:00100000:3.0:1788658483.981267:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:3.0:1788658483.981274:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875544076491776:12345-192.168.202.3@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788658483.981301:0:10289:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:3.0:1788658483.981330:0:10289:0:(genops.c:1385:class_connect()) connect: client df8d83e3-27bc-4e5d-ab80-c17af5c0fb38, cookie 0xf657f176650eb03a 00002000:00100000:3.0:1788658483.981341:0:10289:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df8d83e3-27bc-4e5d-ab80-c17af5c0fb38/ffff9e56ff010000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788658483.981363:0:10289:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788658483.981593:0:10289:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788658483.981621:0:10289:0:(import.c:65:import_set_state_nolock()) ffff9e56ff016800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658483.981761:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2350:x1875544076491776:12345-192.168.202.3@tcp:8:lhsmtool_posix.0 Request processed in 486us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658483.981769:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:0.0:1788658483.998301:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658483.998373:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076491904 00000100:00100000:3.0:1788658483.998382:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076491904 00000100:00100000:3.0:1788658483.998455:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:3.0:1788658483.998465:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:0:x1875544076491904:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788658483.998743:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788658484.086486:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788658484.086503:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000100:00100000:3.0:1788658484.086692:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:0:x1875544076491904:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 88222us (88394us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788658484.086703:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1788658484.091027:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.091284:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076492160 00000100:00100000:3.0:1788658484.091293:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076492160 00000100:00100000:3.0:1788658484.091345:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1788658484.091352:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10472:x1875544076492160:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788658484.091564:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10472:x1875544076492160:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 211us (545us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788658484.091573:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:0.0:1788658484.093988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658484.094104:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076492416 00000100:00100000:2.0:1788658484.094112:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076492416 00000100:00100000:2.0:1788658484.094262:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:2.0:1788658484.094273:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10472:x1875544076492416:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788658484.094379:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10472:x1875544076492416:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 108us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658484.094386:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:1.0:1788658484.097201:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.097324:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076492544 00000100:00100000:3.0:1788658484.097332:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076492544 00000100:00100000:3.0:1788658484.097391:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:3.0:1788658484.097401:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10472:x1875544076492544:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658484.097418:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658484.097437:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae51 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.097511:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.097525:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.097536:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658484.097571:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658484.097590:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.097615:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae51 expref: 59 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.097631:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae51 expref: 58 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.097640:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658484.097642:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788658484.097646:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee400, rc 0) 00000100:00100000:3.0:1788658484.097869:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10472:x1875544076492544:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 468us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.097876:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:0.0:1788658484.099525:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.099580:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076492672 00000100:00100000:3.0:1788658484.099588:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076492672 00000100:00100000:3.0:1788658484.099632:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:3.0:1788658484.099650:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076492672:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658484.099694:0:10289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658484.099712:0:10289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae58 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658484.099738:0:10289:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc333, blocks: 0x1 00010000:00010000:3.0:1788658484.099755:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1788658484.099759:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658484.099768:0:10289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 6 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.099785:0:10289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 6 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.099798:0:10289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eea00, rc 0) 00000100:00100000:3.0:1788658484.099838:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076492672:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 189us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.099844:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:0.0:1788658484.102113:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658484.102623:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076492928 00000100:00100000:1.0:1788658484.102632:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076492928 00000100:00100000:1.0:1788658484.102706:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:1.0:1788658484.102716:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10472:x1875544076492928:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788658484.102818:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10472:x1875544076492928:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 102us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658484.102825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:0.0:1788658484.104793:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.104868:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076493056 00000100:00100000:3.0:1788658484.104875:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076493056 00000100:00100000:3.0:1788658484.104922:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:3.0:1788658484.104932:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:10472:x1875544076493056:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658484.104947:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658484.104963:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae5f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.105010:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 7 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.105018:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658484.105022:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658484.105027:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.105059:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 7 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.105073:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 7 pid: 10289 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.105088:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1875544103778816:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658484.105186:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c1254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658484.107198:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1875544103778816:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658484.107229:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.107246:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef200, rc 0) 00000100:00100000:3.0:1788658484.107294:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:10472:x1875544076493056:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 2363us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.107302:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:1.0:1788658484.109447:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.109496:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076493184 00000100:00100000:3.0:1788658484.109549:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076493184 00010000:00010000:3.0:1788658484.109588:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 7 pid: 10289 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.109722:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:3.0:1788658484.109733:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8937450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076493184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658484.109747:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658484.109768:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 7 pid: 10289 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.109782:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 7 pid: 10289 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.109802:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650eb04f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae58 expref: 7 pid: 10289 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.109818:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658484.109822:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658484.109829:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.109839:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.109888:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.109913:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875544103778944:192.168.202.3@tcp:105: 00000100:00100000:3.0:1788658484.109991:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c1254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658484.113759:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875544103778944:192.168.202.3@tcp:105: 00010000:00010000:3.0:1788658484.113783:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658484.113838:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8937450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076493184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4105us (4394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.113848:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:2.0:1788658484.114813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658484.114899:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076493312 00000100:00100000:0.0:1788658484.114906:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076493312 00002000:00100000:0.0:1788658484.114948:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e5700d73480 x1875544076493312/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:75/0 lens 504/0 e 0 to 0 dl 1788658495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658484.114959:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700d73480 with x1875544076493312 ext(0->8) 00002000:00010000:0.0:1788658484.114964:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5700d73480 00000100:00100000:0.0:1788658484.114995:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658484.115004:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076493312:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788658484.115599:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2351:x1875544076493312:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 594us (785us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788658484.115616:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00002000:00100000:0.0:1788658484.115623:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e5700d73480 x1875544076493312/t4294967302(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:75/0 lens 504/448 e 0 to 0 dl 1788658495 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658484.115631:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700d73480 with x1875544076493312 ext(0->8) 00002000:00010000:0.0:1788658484.115635:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5700d73480 00000100:00100000:1.0:1788658484.118533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658484.118588:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076493440 00000100:00100000:2.0:1788658484.118598:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076493440 00000100:00100000:2.0:1788658484.118721:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:2.0:1788658484.118731:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10472:x1875544076493440:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788658484.124938:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103779072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658484.125008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658484.125064:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103779072 00000100:00100000:1.0:1788658484.125072:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103779072 00000100:00100000:1.0:1788658484.125121:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788658484.125129:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103779072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658484.125149:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658484.125216:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103779072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658484.125223:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658484.125860:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103779072:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788658484.128124:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788658484.146442:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:1.0:1788658484.146471:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788658484.146511:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1788658484.146514:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788658484.146686:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:10472:x1875544076493440:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 27931us (28136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658484.146697:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:0.0:1788658484.147037:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103779200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788658484.147092:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658484.147261:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103779328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788658484.147932:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788658484.148088:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1788658484.148105:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56e5c77840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788658484.148110:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff565900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56e5c77d80 00000020:00080000:1.0:1788658484.148126:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff565500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e570052c000 00000020:00080000:1.0:1788658484.148153:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788658484.148269:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788658484.149276:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658484.149365:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103779200 00000100:00100000:2.0:1788658484.149375:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103779200 00000100:00080000:1.0:1788658484.149447:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658484.149947:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103779328 00000100:00100000:0.0:1788658484.149952:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103779328 00000100:00100000:0.0:1788658484.149973:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076493568 00000100:00100000:0.0:1788658484.149975:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076493568 00000100:00100000:0.0:1788658484.149990:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658484.149999:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103779200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788658484.150027:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788658484.150060:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9cc330, atime: 0x6a9cc331, ctime: 0x6a9cc330, blocks: 0x1 00010000:00010000:0.0:1788658484.150067:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.150083:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1788658484.150088:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658484.150094:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.150127:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.150138:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.150146:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.150165:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788658484.150719:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103779200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 720us (3626us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788658484.150727:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658484.150748:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658484.150756:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103779328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788658484.150845:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788658484.150860:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788658483 00002000:00010000:0.0:1788658484.150863:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788658484.150865:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788658483 -> 1788658483 00002000:00010000:0.0:1788658484.150867:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788658484.150900:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103779328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (2968us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788658484.150907:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658484.150923:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658484.150931:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076493568:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788658484.150974:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658484.150980:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.150990:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658484.150995:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.151005:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.151022:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.151030:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650eb05d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.151048:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658484.151051:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658484.151052:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788658484.151098:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5700d70380/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788658484.151105:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103779200:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788658484.154210:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e57014bfb80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788658484.154225:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103779328:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788658484.166159:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788658484.166174:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788658484.166365:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076493568:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 15430us (17090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658484.166372:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658484.169385:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.169444:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076493824 00000100:00100000:3.0:1788658484.169455:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076493824 00000100:00100000:3.0:1788658484.169571:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:3.0:1788658484.169583:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10472:x1875544076493824:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658484.169747:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658484.169776:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae51 expref: 13 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.169796:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658484.169801:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658484.169894:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.169910:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.169919:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658484.170125:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000408b8910 reply state 000000004ae1212f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658484.170132:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658484.170222:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:10472:x1875544076493824:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 641us (843us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788658484.170229:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:3.0:1788658484.172494:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1788658484.172996:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.173009:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.173017:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.173024:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658484.173028:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.173036:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.173054:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658484.173057:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658484.173062:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.173068:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb064 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658484.173518:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076493952 00000100:00100000:0.0:1788658484.173528:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076493952 00000100:00100000:0.0:1788658484.173581:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1788658484.173590:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076493952:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788658484.173839:0:10289:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788658484.173843:0:10289:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788658483 -> 1788658482 00002000:00010000:0.0:1788658484.173856:0:10289:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788658481 00002000:00010000:0.0:1788658484.173858:0:10289:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788658483 -> 1788658482 00002000:00010000:0.0:1788658484.173861:0:10289:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788658484.173922:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076493952:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 333us (1435us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788658484.173930:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1788658484.176969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658484.177213:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076494208 00000100:00100000:1.0:1788658484.177223:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076494208 00000100:00100000:1.0:1788658484.177271:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:1.0:1788658484.177281:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10472:x1875544076494208:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788658484.177343:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.177357:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.177363:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.177390:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.177400:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 13 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658484.177410:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff751c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103779456:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658484.177492:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658484.180177:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658484.180297:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff751c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103779456:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658484.180334:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658484.180409:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076494336 00000100:00100000:0.0:1788658484.180416:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076494336 00010000:00010000:0.0:1788658484.180451:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 14 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658484.180489:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1788658484.180499:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2352:x1875544076494336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658484.180513:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658484.180519:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 14 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.180531:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 14 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.180563:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae43 expref: 14 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.180577:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658484.180582:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.180592:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.180599:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.180627:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658484.180706:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2352:x1875544076494336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 208us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658484.180713:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00010000:00010000:1.0:1788658484.180765:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180772:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180797:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180804:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180811:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180816:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658484.180820:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180829:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180837:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:1.0:1788658484.180840:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788658484.180853:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.180860:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb06b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658484.180917:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:10472:x1875544076494208:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 3638us (3955us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788658484.180924:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:2.0:1788658484.183083:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.183247:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076494464 00000100:00100000:3.0:1788658484.183257:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076494464 00000100:00100000:3.0:1788658484.183312:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:3.0:1788658484.183322:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076494464:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788658484.183365:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.183385:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.183393:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658484.183398:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658484.183402:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.183454:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.183469:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 7 pid: 6685 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.183484:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1875544103779584:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658484.183916:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e5c77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658484.186792:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658484.186834:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076494592 00000100:00100000:0.0:1788658484.186852:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076494592 00010000:00010000:0.0:1788658484.186889:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 8 pid: 6685 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658484.186932:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1788658484.186941:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076494592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658484.186955:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658484.186977:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 8 pid: 6685 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.187007:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 8 pid: 6685 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.187033:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658484.187038:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658484.187044:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.187053:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.187072:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658484.187122:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076494592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 183us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658484.187130:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00010000:00010000:3.0:1788658484.187949:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaeb0fae/0xf657f176650eb056 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae5f expref: 7 pid: 6685 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.187968:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1875544103779584:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658484.187999:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188095:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188105:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188136:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188145:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188209:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188219:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658484.188224:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188234:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188249:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.188265:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb072 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658484.188338:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076494464:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 5017us (5262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658484.188346:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:2.0:1788658484.190411:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658484.190469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076494848 00000100:00100000:0.0:1788658484.190478:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076494848 00000100:00100000:0.0:1788658484.190531:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:0.0:1788658484.190540:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:10472:x1875544076494848:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788658484.190615:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.190632:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.190643:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.190890:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.190902:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.190911:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.190943:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658484.190957:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 13 pid: 5839 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658484.190970:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103779712:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658484.191147:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c38d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658484.193466:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103779712:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658484.193493:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658484.196005:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.196080:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076494976 00000100:00100000:3.0:1788658484.196090:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076494976 00010000:00010000:3.0:1788658484.196126:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 14 pid: 5839 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.196250:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1788658484.196260:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2351:x1875544076494976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658484.196274:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658484.196280:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 14 pid: 5839 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.196294:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 14 pid: 5839 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.196314:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae4a expref: 14 pid: 5839 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.196330:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658484.196336:0:7635:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.196345:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.196352:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.196434:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658484.196498:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2351:x1875544076494976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 238us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.196514:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00010000:00010000:2.0:1788658484.196918:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.196927:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658484.197112:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788658484.197473:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788658484.197583:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788658484.197779:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1875544103779840:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788658484.197839:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658484.197878:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658484.197923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103779840 00000100:00100000:3.0:1788658484.197929:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103779840 00000100:00100000:3.0:1788658484.197975:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658484.197984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875544103779840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788658484.198059:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875544103779840:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.198066:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658484.198222:0:5838:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788658484.198227:0:5838:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e57014bfb80, transno 4294967303 00000100:00100000:2.0:1788658484.198284:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1875544103779840:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788658484.198832:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788658484.198894:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1875544103779968:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788658484.198925:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658484.198944:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8ddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658484.199032:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103779968 00000100:00100000:3.0:1788658484.199037:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103779968 00000100:00100000:3.0:1788658484.199071:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658484.199078:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875544103779968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788658484.199355:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1875544103779968:12345-0@lo:1000:mdt00_001.0 Request processed in 276us (427us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788658484.199362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658484.199895:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1875544103779968:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788658484.199925:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.199934:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.199941:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.199947:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658484.199951:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.199958:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.199972:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658484.199974:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658484.199979:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.199984:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb080 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200019:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200032:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200037:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200042:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658484.200045:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200051:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200059:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:2.0:1788658484.200061:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658484.200064:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200070:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eafae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200090:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200103:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200112:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200138:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658484.200257:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 16 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658484.200270:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103780096:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658484.200369:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8ddd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658484.206741:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658484.206922:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076495104 00000100:00100000:1.0:1788658484.206933:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076495104 00010000:00010000:1.0:1788658484.206973:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 17 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658484.207016:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:1.0:1788658484.207026:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:2351:x1875544076495104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658484.207041:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658484.207047:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 17 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.207061:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 17 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.207081:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:1.0:1788658484.207087:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.207096:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.207104:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.207123:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658484.207198:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:2351:x1875544076495104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 173us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658484.207205:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00010000:00010000:3.0:1788658484.207514:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eafca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae2e expref: 16 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.207530:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103780096:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658484.207549:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207558:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207570:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207581:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207587:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207594:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207599:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ae00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658484.207603:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207611:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207621:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:3.0:1788658484.207623:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658484.207627:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207633:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb087 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207644:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207650:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207661:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207699:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658484.207702:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207708:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207715:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:3.0:1788658484.207718:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658484.207720:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.207726:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb079 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658484.207932:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:10472:x1875544076494848:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 17392us (17528us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788658484.207941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00000020:00080000:3.0:1788658484.207944:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788658484.208313:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658484.208319:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658484.208348:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788658484.208356:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658484.213256:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658484.213310:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076495360 00000100:00100000:3.0:1788658484.213319:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076495360 00000100:00100000:3.0:1788658484.213374:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:3.0:1788658484.213384:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:10472:x1875544076495360:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788658484.214021:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788658484.214125:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788658484.214175:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.214192:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.214204:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.214214:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.214221:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.214227:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658484.214251:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658484.214336:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:10472:x1875544076495360:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 952us (1086us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788658484.214343:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000020:00080000:3.0:1788658484.214348:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788658484.214474:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658484.214481:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.214488:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658484.214493:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.214501:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.214513:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:1.0:1788658484.214516:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788658484.214520:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.214527:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb08e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658484.214543:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658484.214545:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658484.214547:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658484.392238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658484.392277:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658484.392314:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658484.392448:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076495488 00000100:00100000:1.0:1788658484.392457:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076495488 00000100:00100000:1.0:1788658484.392527:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 287 00000100:00100000:1.0:1788658484.392537:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076495488:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658484.392604:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076495488:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 68us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658484.392612:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 287 00000100:00100000:0.0:1788658484.392812:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076495744 00000100:00100000:0.0:1788658484.392817:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076495744 00000100:00100000:0.0:1788658484.392875:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00100000:0.0:1788658484.392882:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076495744:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658484.392918:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076495744:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658484.392924:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00080000:1.0:1788658484.393002:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658484.393053:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076495616 00000100:00100000:3.0:1788658484.393057:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076495616 00000100:00100000:3.0:1788658484.393100:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:3.0:1788658484.393106:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076495616:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658484.393138:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076495616:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 32us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.393144:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00080000:1.0:1788658484.393262:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658484.638456:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103780608:0@lo:400:kworker.0 00000100:00100000:1.0:1788658484.638478:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103780224:0@lo:400:kworker.0 00000100:00100000:2.0:1788658484.638562:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103780352:0@lo:400:kworker.0 00000100:00100000:0.0:1788658484.639305:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103780480:0@lo:400:kworker.0 00000100:00100000:3.0:1788658484.662146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658484.662264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103780608 00000100:00100000:3.0:1788658484.662272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103780608 00000100:00100000:3.0:1788658484.662325:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788658484.662334:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103780608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658484.662394:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103780608:12345-0@lo:400:kworker.0 Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.662400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1788658484.662418:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658484.662451:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103780608:0@lo:400:kworker.0 00000100:00100000:1.0:1788658484.663391:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658484.663831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658484.665315:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658484.665449:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103780352 00000100:00100000:2.0:1788658484.665458:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103780352 00000100:00100000:2.0:1788658484.665505:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103780480 00000100:00100000:2.0:1788658484.665508:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103780480 00000100:00100000:2.0:1788658484.665539:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788658484.665547:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103780352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658484.665727:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788658484.665736:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103780480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658484.665803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103780480:12345-0@lo:400:kworker.0 Request processed in 58us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658484.665811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788658484.665868:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103780480:0@lo:400:kworker.0 00000100:00080000:0.0:1788658484.665901:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658484.666898:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103780352:12345-0@lo:400:kworker.0 Request processed in 1347us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658484.666908:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788658484.667922:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103780224 00000100:00100000:3.0:1788658484.667933:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103780224 00000100:00100000:3.0:1788658484.668000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788658484.668010:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103780224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658484.668088:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103780224:12345-0@lo:400:kworker.0 Request processed in 80us (4700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.668095:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788658484.669504:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103780224:0@lo:400:kworker.0 00000100:00100000:1.0:1788658484.670181:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103780352:0@lo:400:kworker.0 00010000:00010000:2.0:1788658484.959555:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658485.149883:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658485.149911:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103780736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658485.149981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658485.150107:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103780736 00000100:00100000:2.0:1788658485.150115:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103780736 00000100:00100000:2.0:1788658485.150165:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658485.150175:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103780736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658485.150218:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658485.150272:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103780736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658485.150279:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788658485.150382:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103780736:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788658485.718301:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658485.718311:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658485.718351:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788658485.718359:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658485.848780:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658485.848867:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076496000 00000100:00100000:3.0:1788658485.848876:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076496000 00000100:00100000:3.0:1788658485.848944:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:3.0:1788658485.848954:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:10490:x1875544076496000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658485.848976:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658485.849005:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae66 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.849105:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eb09c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.849120:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eb09c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.849132:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eb09c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658485.849142:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788658485.849255:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae66 expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.849273:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eb09c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae66 expref: 19 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.849282:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658485.849285:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658485.849288:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eea00, rc 0) 00000100:00100000:3.0:1788658485.849341:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:10490:x1875544076496000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 388us (570us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788658485.849349:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00080000:0.0:1788658485.849502:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658485.853652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658485.853835:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076496128 00000100:00100000:0.0:1788658485.853845:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076496128 00000100:00100000:0.0:1788658485.853907:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:0.0:1788658485.853916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:10490:x1875544076496128:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:0.0:1788658485.853991:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854007:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854018:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854031:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854038:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854060:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854279:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854288:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854295:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658485.854332:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854345:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854351:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854358:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854364:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658485.854368:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854374:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854385:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:0.0:1788658485.854393:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658485.854399:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854406:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb0aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854419:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854425:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854430:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854447:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658485.854450:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854456:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854464:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56c3c69a00) 00010000:00010000:0.0:1788658485.854466:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658485.854469:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854475:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb0b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854490:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854502:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854508:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854514:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658485.854517:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854522:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854530:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:0.0:1788658485.854532:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658485.854535:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.854540:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb0b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658485.854625:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:10490:x1875544076496128:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 709us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658485.854633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:0.0:1788658485.889333:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658485.889417:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076496384 00000100:00100000:2.0:1788658485.889427:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076496384 00000100:00100000:2.0:1788658485.889492:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:2.0:1788658485.889504:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:10493:x1875544076496384:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658485.889528:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658485.889550:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb0bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae6d expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.889621:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.889637:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.889659:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.889705:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.889713:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.889720:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890005:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890014:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890021:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658485.890032:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788658485.890130:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890137:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890143:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890148:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658485.890153:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890160:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890172:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658485.890175:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658485.890179:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890196:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890209:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890215:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890221:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890226:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658485.890229:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890234:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890242:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d579c900) 00010000:00010000:2.0:1788658485.890245:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658485.890248:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890254:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb0cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890297:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb0bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 22 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890323:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 21 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.890330:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:2.0:1788658485.890333:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658485.890336:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a800, rc 0) 00000100:00100000:2.0:1788658485.890399:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10493:x1875544076496384:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 897us (1078us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788658485.890406:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:3.0:1788658485.902438:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658485.903617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076496512 00000100:00100000:1.0:1788658485.903632:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076496512 00000100:00100000:1.0:1788658485.903793:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:1.0:1788658485.903806:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10493:x1875544076496512:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:1.0:1788658485.903875:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903892:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903905:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903934:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903947:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903954:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903972:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658485.903977:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903985:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.903997:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:1.0:1788658485.904001:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658485.904006:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.904012:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb0e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658485.904086:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10493:x1875544076496512:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 283us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658485.904094:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:0.0:1788658485.911304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658485.911350:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076496768 00000100:00100000:0.0:1788658485.911361:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076496768 00000100:00100000:0.0:1788658485.911438:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1788658485.911449:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10493:x1875544076496768:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658485.911722:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:10493:x1875544076496768:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 274us (425us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788658485.911730:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1788658485.954267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658485.954354:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076497024 00000100:00100000:3.0:1788658485.954365:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076497024 00000100:00100000:3.0:1788658485.954422:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:3.0:1788658485.954445:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:10013:x1875544076497024:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658485.954468:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658485.954489:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb0e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.954611:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.954627:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 23 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.954636:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.954706:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 23 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.954720:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 23 pid: 11367 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658485.954735:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103780864:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658485.954819:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c20b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658485.958709:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658485.958848:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103780864:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658485.958876:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658485.959009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076497152 00000100:00100000:0.0:1788658485.959017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076497152 00010000:00010000:0.0:1788658485.959059:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 24 pid: 11367 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658485.959099:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:0.0:1788658485.959110:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:2352:x1875544076497152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658485.959125:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658485.959132:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 24 pid: 11367 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.959146:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 24 pid: 11367 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.959167:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb0d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae6d expref: 24 pid: 11367 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.959181:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:0.0:1788658485.959187:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.959196:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.959219:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.959263:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658485.959284:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.959299:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658485.959335:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:2352:x1875544076497152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 225us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658485.959343:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000004:00200000:1.0:1788658485.959369:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788658485.959640:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb0e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.959693:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.959702:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:1.0:1788658485.959705:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788658485.959707:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef200, rc 0) 00000100:00100000:1.0:1788658485.959745:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:10013:x1875544076497024:12345-192.168.202.3@tcp:101:bash.0 Request processed in 5302us (5486us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788658485.959753:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:3.0:1788658485.962299:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658485.962738:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076497408 00000100:00100000:2.0:1788658485.962749:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076497408 00000100:00100000:2.0:1788658485.962798:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:2.0:1788658485.962807:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:10013:x1875544076497408:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:2.0:1788658485.963067:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.963085:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658485.963097:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658485.963149:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788658485.963175:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a74086a6 reply state 000000009db63f35 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658485.963184:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788658485.963249:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788658485.963354:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:10013:x1875544076497408:12345-192.168.202.3@tcp:36:bash.0 Request processed in 546us (1061us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788658485.963362:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 89 00000020:00080000:2.0:1788658485.963368:0:6710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788658485.966222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1788658485.966408:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.966420:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.966428:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.966434:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658485.966439:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.966463:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.966480:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:1.0:1788658485.966483:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658485.966488:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658485.966494:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb0fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658485.966837:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076497536 00000100:00100000:3.0:1788658485.966847:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076497536 00000100:00100000:3.0:1788658485.967026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:3.0:1788658485.967037:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:10013:x1875544076497536:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658485.967078:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658485.967095:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae7b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.967147:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae7b expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.967160:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae7b expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658485.967177:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:3.0:1788658485.967180:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658485.967183:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef400, rc 0) 00000100:00100000:3.0:1788658485.967246:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:10013:x1875544076497536:12345-192.168.202.3@tcp:101:bash.0 Request processed in 212us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658485.967253:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:2.0:1788658485.969946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658485.970036:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076497664 00000100:00100000:0.0:1788658485.970044:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076497664 00000100:00100000:0.0:1788658485.970156:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:0.0:1788658485.970167:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:10013:x1875544076497664:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658485.970182:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658485.970215:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae82 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658485.970239:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cc332, atime: 0x6a9cc331, ctime: 0x6a9cc332, blocks: 0xb 00010000:00010000:0.0:1788658485.970256:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1788658485.970260:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658485.970268:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.970285:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658485.970297:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78e00, rc 0) 00000100:00100000:0.0:1788658485.970358:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:10013:x1875544076497664:12345-192.168.202.3@tcp:101:bash.0 Request processed in 193us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658485.970381:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00080000:3.0:1788658485.972065:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658485.972743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658485.972787:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076497792 00000100:00100000:0.0:1788658485.972796:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076497792 00002000:00010000:0.0:1788658485.972839:0:6690:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788658485.972844:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56ff752a00 with x1875544076497792 ext(0->18446744073709551615) 00002000:00010000:0.0:1788658485.972855:0:6690:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56ff752a00. 00000100:00100000:0.0:1788658485.972887:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:0.0:1788658485.972897:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2354:x1875544076497792:12345-192.168.202.3@tcp:10:bash.0 00002000:00010000:0.0:1788658485.973227:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788658485.973231:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788658482 -> 1788658485 00002000:00010000:0.0:1788658485.973234:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788658481 -> 1788658481 00002000:00010000:0.0:1788658485.973236:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788658482 -> 1788658485 00002000:00010000:0.0:1788658485.973238:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788658485.973294:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2354:x1875544076497792:12345-192.168.202.3@tcp:10:bash.0 Request processed in 398us (555us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788658485.973302:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00002000:00010000:0.0:1788658485.973305:0:6690:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788658485.973308:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56ff752a00 with x1875544076497792 ext(0->18446744073709551615) 00002000:00010000:0.0:1788658485.973314:0:6690:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56ff752a00. 00010000:00010000:2.0:1788658485.980892:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658486.055710:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658486.055829:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076497920 00000100:00100000:2.0:1788658486.055840:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076497920 00000100:00100000:2.0:1788658486.055909:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:2.0:1788658486.055920:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:10507:x1875544076497920:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:2.0:1788658486.056005:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056022:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056034:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056215:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056225:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056232:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056442:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056462:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056469:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658486.056507:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056518:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056526:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056533:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056539:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658486.056544:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056552:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056563:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658486.056566:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658486.056570:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056576:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056594:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056600:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056605:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056610:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658486.056612:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056618:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056625:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d579c900) 00010000:00010000:2.0:1788658486.056628:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658486.056642:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056649:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb11a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056686:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056693:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056698:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056708:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658486.056711:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056717:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056725:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:2.0:1788658486.056727:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658486.056730:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.056734:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.056815:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:10507:x1875544076497920:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 894us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658486.056823:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:2.0:1788658486.098451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658486.098584:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076498176 00000100:00100000:3.0:1788658486.098594:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076498176 00000100:00100000:3.0:1788658486.098692:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:3.0:1788658486.098702:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:10510:x1875544076498176:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658486.098723:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658486.098743:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb128 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae89 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.098815:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.098840:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.098852:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.098868:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.098876:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.098883:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099242:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb13d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099249:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099254:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658486.099261:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788658486.099331:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099336:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099341:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099350:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658486.099353:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099359:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099367:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658486.099369:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658486.099373:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099377:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb12f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099385:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099389:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099392:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099395:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658486.099397:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099400:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099421:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810f00) 00010000:00010000:3.0:1788658486.099423:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658486.099425:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099429:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099459:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae89 expref: 30 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099467:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb13d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae89 expref: 29 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.099471:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:3.0:1788658486.099473:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788658486.099474:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eee00, rc 0) 00000100:00100000:3.0:1788658486.099535:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10510:x1875544076498176:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 834us (1091us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788658486.099543:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:3.0:1788658486.101980:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658486.102046:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076498304 00000100:00100000:1.0:1788658486.102057:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076498304 00000100:00100000:1.0:1788658486.102182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:1.0:1788658486.102192:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10510:x1875544076498304:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:1.0:1788658486.102264:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.102278:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.102287:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.102319:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.102351:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 29 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658486.102365:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff752d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103780992:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658486.102475:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56dea96f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658486.110197:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff752d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103780992:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658486.110227:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658486.111489:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.118032:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076498560 00000100:00100000:0.0:1788658486.118051:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076498560 00000100:00100000:0.0:1788658486.118138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1788658486.118150:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+30:5589:x1875544076498560:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788658486.118481:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:5589:x1875544076498560:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 332us (6998us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788658486.118863:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:1.0:1788658486.123054:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.125574:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076498688 00000100:00100000:0.0:1788658486.125588:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076498688 00010000:00010000:0.0:1788658486.125649:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 31 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658486.125743:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1788658486.125758:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:2351:x1875544076498688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658486.125796:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658486.125803:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 31 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.125817:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 31 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.125843:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb0f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae74 expref: 31 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.125862:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:0.0:1788658486.125868:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.125877:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.125885:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.125930:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658486.125993:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+30:2351:x1875544076498688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 240us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658486.126001:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00010000:00010000:3.0:1788658486.126077:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126091:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126124:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126131:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126136:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126141:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658486.126145:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126152:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126161:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:3.0:1788658486.126164:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658486.126167:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.126172:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb14b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658486.126212:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10510:x1875544076498304:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 24022us (24242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.126220:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:2.0:1788658486.128518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.128598:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076498944 00000100:00100000:0.0:1788658486.128608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076498944 00000100:00100000:0.0:1788658486.128713:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:0.0:1788658486.128723:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:10510:x1875544076498944:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658486.128979:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+30:10510:x1875544076498944:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 257us (468us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788658486.128987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:1.0:1788658486.225999:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.226099:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076499200 00000100:00100000:0.0:1788658486.226110:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076499200 00000100:00100000:0.0:1788658486.226163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:0.0:1788658486.226171:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+30:10521:x1875544076499200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1788658486.226192:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658486.226209:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226271:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226283:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226291:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226326:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226332:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226336:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226597:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226606:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226624:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658486.226633:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788658486.226762:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226770:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226775:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226778:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658486.226781:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226794:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226802:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:0.0:1788658486.226804:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658486.226807:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226812:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226820:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226824:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226828:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226831:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658486.226832:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226835:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226838:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56c3c69300) 00010000:00010000:0.0:1788658486.226840:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658486.226841:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226850:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226886:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae90 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226895:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae90 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.226899:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:0.0:1788658486.226901:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658486.226903:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658486.226955:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:10521:x1875544076499200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 784us (965us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788658486.226962:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:1.0:1788658486.232843:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.232918:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076499456 00000100:00100000:0.0:1788658486.232930:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076499456 00000100:00100000:0.0:1788658486.232995:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:0.0:1788658486.233007:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:10521:x1875544076499456:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1788658486.233233:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:10521:x1875544076499456:12345-192.168.202.3@tcp:35:cat.0 Request processed in 228us (398us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788658486.233238:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000040:00080000:1.0:1788658486.237136:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658486.237145:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658486.237175:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788658486.237184:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658486.268788:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.268954:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076499712 00000100:00100000:0.0:1788658486.268965:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076499712 00000100:00100000:0.0:1788658486.269025:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:0.0:1788658486.269035:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:10522:x1875544076499712:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:0.0:1788658486.269112:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788658486.269143:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae90 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269169:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb13d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae89 expref: 32 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269181:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae7b expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269192:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:0.0:1788658486.269205:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658486.269226:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269240:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269249:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269263:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269269:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.269274:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.270105:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.270119:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.270128:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658486.272251:0:11367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788658486.272266:0:11367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377411600465ns, next at 378411597625ns, rc = 0 00010000:00010000:0.0:1788658486.272356:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272373:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272786:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272798:0:11367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272804:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272810:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272838:0:11367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658486.272861:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272876:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272882:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272887:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658486.272891:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272898:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272910:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56c3c69b00) 00010000:00010000:0.0:1788658486.272921:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788658486.272927:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272934:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb183 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272955:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272960:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272966:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272971:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658486.272979:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272986:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.272994:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:0.0:1788658486.272997:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658486.272999:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.273004:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb175 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658486.273016:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a27aa123 reply state 00000000bdfa6bbf transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658486.273025:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658486.273126:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:10522:x1875544076499712:12345-192.168.202.3@tcp:36:rm.0 Request processed in 4090us (4345us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788658486.273135:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 95 00010000:00010000:1.0:1788658486.275215:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658486.275226:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.275236:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658486.275240:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.275251:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.275267:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e56c3c69b00) 00010000:00010000:1.0:1788658486.275269:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788658486.275273:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.275294:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb18a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.275331:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658486.275333:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658486.275335:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658486.276868:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.276883:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.276890:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.276925:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658486.276931:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.276939:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.276955:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56c3c69300) 00010000:00010000:2.0:1788658486.276958:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658486.276963:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.276970:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb17c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.339795:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658486.340117:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076499968 00000100:00100000:3.0:1788658486.340127:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076499968 00000100:00100000:3.0:1788658486.340191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:3.0:1788658486.340202:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:10528:x1875544076499968:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658486.340228:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658486.340249:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb191 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.340389:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.340404:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.340416:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.340431:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.340437:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.340443:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658486.341652:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788658486.341872:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.341886:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.341907:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.342569:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.342577:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.342584:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.342590:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658486.342594:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.342614:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.342627:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658486.342630:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658486.342636:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.342643:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb198 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658486.342660:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025ef7ce2 reply state 000000008b390fde transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658486.344149:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788658486.344215:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb191 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.344235:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.344244:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810a00) 00010000:00010000:3.0:1788658486.344247:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658486.344251:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658486.344514:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:10528:x1875544076499968:12345-192.168.202.3@tcp:101:bash.0 Request processed in 4312us (4726us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788658486.344523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 96 00010000:00010000:1.0:1788658486.357472:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.357493:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.357502:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.357508:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658486.357513:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.357521:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.357540:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810f00) 00010000:00010000:1.0:1788658486.357543:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658486.357547:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.357554:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb19f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.360835:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658486.360956:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076500096 00000100:00100000:3.0:1788658486.360967:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076500096 00000100:00100000:3.0:1788658486.361085:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:3.0:1788658486.361096:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076500096:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658486.361116:0:10289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658486.361137:0:10289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8ae9e expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658486.361166:0:10289:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658486.361192:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1788658486.361197:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658486.361206:0:10289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 8 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.361225:0:10289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 8 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.361256:0:10289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee400, rc 0) 00000100:00100000:3.0:1788658486.361321:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076500096:12345-192.168.202.3@tcp:101:bash.0 Request processed in 227us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.361328:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00080000:0.0:1788658486.361708:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658486.364460:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658486.365814:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076500224 00000100:00100000:2.0:1788658486.365830:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076500224 00000100:00100000:2.0:1788658486.365913:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:2.0:1788658486.365923:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:10528:x1875544076500224:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1788658486.365941:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658486.365960:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aea5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.365993:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 9 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.366023:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658486.366027:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658486.366033:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.366067:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 9 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.366080:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 9 pid: 10289 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.366094:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875544103781120:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658486.366190:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658486.369126:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875544103781120:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658486.369166:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.369187:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a000, rc 0) 00000100:00100000:3.0:1788658486.369258:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:10528:x1875544076500224:12345-192.168.202.3@tcp:101:bash.0 Request processed in 3336us (4805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.369266:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:3.0:1788658486.370334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.370572:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076500352 00000100:00100000:0.0:1788658486.370584:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076500352 00010000:00010000:0.0:1788658486.370641:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 9 pid: 10289 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658486.370714:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1788658486.370724:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8934850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2351:x1875544076500352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658486.370739:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658486.370780:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 9 pid: 10289 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.370793:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 9 pid: 10289 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.370814:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb1b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae9e expref: 9 pid: 10289 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.370829:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658486.370842:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658486.370851:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.370861:0:7635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.370901:0:7635:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658486.370924:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7635:1875544103781248:192.168.202.3@tcp:105: 00000100:00100000:0.0:1788658486.371049:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c38d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658486.386147:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658486.386874:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076500608 00000100:00100000:1.0:1788658486.386895:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076500608 00000100:00100000:1.0:1788658486.386966:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:1.0:1788658486.386975:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:10528:x1875544076500608:12345-192.168.202.3@tcp:35:bash.0 00000001:00080000:1.0:1788658486.387345:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:1.0:1788658486.387502:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10528:x1875544076500608:12345-192.168.202.3@tcp:35:bash.0 Request processed in 526us (1364us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788658486.387510:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000020:00080000:1.0:1788658486.387515:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788658486.389448:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7635:1875544103781248:192.168.202.3@tcp:105: 00010000:00010000:3.0:1788658486.389475:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658486.389528:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8934850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2351:x1875544076500352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 18805us (19215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.389537:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1788658486.446524:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.446575:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658486.446705:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076500736 00000100:00100000:1.0:1788658486.446717:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076500736 00002000:00100000:1.0:1788658486.446784:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e5700d71c00 x1875544076500736/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:77/0 lens 504/0 e 0 to 0 dl 1788658497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658486.446794:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700d71c00 with x1875544076500736 ext(0->8) 00002000:00010000:1.0:1788658486.446799:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e5700d71c00 00000100:00100000:1.0:1788658486.446823:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1788658486.446833:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2353:x1875544076500736:12345-192.168.202.3@tcp:4:bash.0 00000100:00100000:1.0:1788658486.447468:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2353:x1875544076500736:12345-192.168.202.3@tcp:4:bash.0 Request processed in 633us (949us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788658486.447476:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00002000:00100000:1.0:1788658486.447482:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e5700d71c00 x1875544076500736/t4294967302(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:77/0 lens 504/448 e 0 to 0 dl 1788658497 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658486.447490:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700d71c00 with x1875544076500736 ext(0->8) 00002000:00010000:1.0:1788658486.447493:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e5700d71c00 00000100:00100000:3.0:1788658486.447881:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076500864 00000100:00100000:3.0:1788658486.447886:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076500864 00000100:00100000:3.0:1788658486.447914:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:3.0:1788658486.447923:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2353:x1875544076500864:12345-192.168.202.3@tcp:16:kworker.0 00000100:00100000:0.0:1788658486.555111:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2353:x1875544076500864:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 107166us (108512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658486.555139:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000001:00080000:2.0:1788658486.555556:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1788658486.555568:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1788658486.555589:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788658486.641739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658486.642066:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076500992 00000100:00100000:3.0:1788658486.642077:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076500992 00000100:00100000:3.0:1788658486.642184:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:3.0:1788658486.642196:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:10544:x1875544076500992:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658486.642219:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658486.642238:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aeac expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.642316:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb1c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.642330:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.642342:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658486.642376:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788658486.642380:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658486.642398:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.642422:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeac expref: 37 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.642438:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeac expref: 36 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.642447:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658486.642463:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658486.642467:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eec00, rc 0) 00000100:00100000:3.0:1788658486.642533:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+36:10544:x1875544076500992:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 339us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.642541:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:0.0:1788658486.654000:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658486.654137:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076501248 00000100:00100000:2.0:1788658486.654148:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076501248 00000100:00100000:2.0:1788658486.654217:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:2.0:1788658486.654228:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+36:10544:x1875544076501248:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658486.654249:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658486.654270:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb1d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aeb3 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.654386:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.654400:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.654413:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658486.654424:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788658486.654547:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb1d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeb3 expref: 39 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.654575:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeb3 expref: 38 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.654583:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810a00) 00010000:00010000:2.0:1788658486.654586:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658486.654589:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891be00, rc 0) 00000100:00100000:2.0:1788658486.654650:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:10544:x1875544076501248:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 424us (660us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788658486.654657:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:0.0:1788658486.670182:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.670239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658486.670386:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076501376 00000100:00100000:1.0:1788658486.670397:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076501376 00000100:00100000:1.0:1788658486.670466:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1788658486.670492:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:2352:x1875544076501376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658486.670510:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658486.670535:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb1d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeb3 expref: 38 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.670557:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810a00) 00010000:00010000:1.0:1788658486.670572:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658486.670628:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:2352:x1875544076501376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 138us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.670636:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658486.675252:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076501632 00000100:00100000:3.0:1788658486.675269:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076501632 00000100:00100000:3.0:1788658486.675413:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:3.0:1788658486.675425:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:10544:x1875544076501632:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658486.675454:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658486.675478:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb1e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aeba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.675611:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.675630:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.675641:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658486.675652:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788658486.675834:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb1e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeba expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.675855:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeba expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.675864:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810a00) 00010000:00010000:3.0:1788658486.675883:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788658486.675900:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:3.0:1788658486.677171:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:10544:x1875544076501632:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1742us (6924us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788658486.677181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:0.0:1788658486.701722:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658486.702122:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076501760 00000100:00100000:2.0:1788658486.702134:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076501760 00000100:00100000:2.0:1788658486.702199:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:2.0:1788658486.702209:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076501760:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1788658486.702256:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.702290:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.702299:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658486.702303:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658486.702307:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.702344:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.702359:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 6 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.702374:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103781376:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658486.702470:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658486.706502:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103781376:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658486.706531:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658486.716099:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658486.718119:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076501888 00000100:00100000:2.0:1788658486.718134:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076501888 00010000:00010000:2.0:1788658486.718193:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 7 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.718270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:2.0:1788658486.718282:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076501888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658486.718300:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788658486.718321:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788658486.718324:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788658486 00002000:00010000:2.0:1788658486.718326:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788658486 00002000:00010000:2.0:1788658486.718328:0:5824:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788658486.718334:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 7 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.718348:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 7 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.718373:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009396da2c/0xf657f176650eb1bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aea5 expref: 7 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.718389:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658486.718393:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658486.718400:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.718410:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.718451:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658486.718640:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718651:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718705:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718713:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718720:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718726:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658486.718731:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718740:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718762:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.718781:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650eb1fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.718894:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076501888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 613us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658486.718902:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:0.0:1788658486.721103:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2353:x1875544076501760:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 18884us (19392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658486.721117:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:0.0:1788658486.732885:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658486.733012:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076502144 00000100:00100000:3.0:1788658486.733029:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076502144 00000100:00100000:3.0:1788658486.733111:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:3.0:1788658486.733122:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:10544:x1875544076502144:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:3.0:1788658486.733208:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeba expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658486.733945:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788658486.734159:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788658486.734763:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1788658486.735177:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.735203:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.735214:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.735268:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.735289:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 43 pid: 5839 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658486.735988:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875544103781504:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658486.736429:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658486.742311:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875544103781504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658486.742343:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658486.752497:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658486.753123:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076502272 00000100:00100000:1.0:1788658486.753136:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076502272 00010000:00010000:1.0:1788658486.753187:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 44 pid: 5839 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658486.753233:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:1.0:1788658486.753243:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+44:2351:x1875544076502272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658486.753258:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658486.753264:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 44 pid: 5839 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.753279:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 44 pid: 5839 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.753302:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb1a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae97 expref: 44 pid: 5839 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.753334:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810a00) 00010000:00010000:1.0:1788658486.753340:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.753348:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.753355:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658486.753386:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658486.753439:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:2351:x1875544076502272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 197us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.753445:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00010000:00010000:3.0:1788658486.753509:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.753517:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658486.753648:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1788658486.753920:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788658486.754041:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103781632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788658486.754093:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658486.754121:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1602000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658486.755408:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103781632 00000100:00100000:1.0:1788658486.755420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103781632 00000100:00100000:1.0:1788658486.755483:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658486.755492:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875544103781632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788658486.755607:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875544103781632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.755616:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658486.755723:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788658486.755730:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788658486.755750:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5700d70380, transno 4294967301 00000100:00100000:2.0:1788658486.755765:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103781632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788658486.756620:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788658486.756748:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700529180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103781760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788658486.757101:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658486.757129:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8dd000 going to sleep for 11 seconds 00000100:00080000:0.0:1788658486.757216:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658486.757433:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103781760 00000100:00100000:1.0:1788658486.757441:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103781760 00000100:00100000:1.0:1788658486.757480:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658486.757489:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875544103781760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788658486.757738:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875544103781760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 249us (636us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788658486.757757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658486.760485:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700529180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103781760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788658486.760600:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788658486.760699:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.760710:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.760717:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.760723:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658486.760727:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.760736:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.760782:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810a00) 00010000:00010000:2.0:1788658486.760785:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788658486.761150:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.761159:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb201 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658486.761380:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788658486.761468:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788658486.761480:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377900813955ns, next at 378900811959ns, rc = 0 00000001:00080000:2.0:1788658486.761487:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788658486.761522:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810a00) 00010000:00010000:2.0:1788658486.761525:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788658486.761533:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb1ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeba expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.762099:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+46:10544:x1875544076502144:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 28974us (29219us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788658486.762110:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000020:00080000:2.0:1788658486.762116:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788658486.774770:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658486.774942:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076502400 00000100:00100000:3.0:1788658486.774957:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076502400 00000100:00100000:3.0:1788658486.775043:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:3.0:1788658486.775056:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+46:10544:x1875544076502400:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658486.775090:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658486.775120:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aec1 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.775199:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec1 expref: 47 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.775234:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec1 expref: 47 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.775258:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:3.0:1788658486.775261:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658486.775267:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efe00, rc 0) 00000100:00100000:3.0:1788658486.775463:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:10544:x1875544076502400:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 409us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.775470:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:0.0:1788658486.789542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658486.789661:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076502656 00000100:00100000:1.0:1788658486.789711:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076502656 00000100:00100000:1.0:1788658486.790125:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:1.0:1788658486.790139:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:10544:x1875544076502656:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658486.790404:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:10544:x1875544076502656:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 265us (870us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788658486.797316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:3.0:1788658486.907848:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658486.908190:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076502784 00000100:00100000:0.0:1788658486.908200:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076502784 00000100:00100000:0.0:1788658486.908274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:0.0:1788658486.908285:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:10554:x1875544076502784:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:0.0:1788658486.908365:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908384:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908397:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908429:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908436:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908442:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908529:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908548:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908555:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658486.908593:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908606:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908613:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908620:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908626:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658486.908630:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908644:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908656:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:0.0:1788658486.908659:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658486.908691:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908699:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb20f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908713:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908719:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908725:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908730:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658486.908733:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908739:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908746:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56c3c69000) 00010000:00010000:0.0:1788658486.908748:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658486.908751:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908766:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908782:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908788:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908793:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908798:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658486.908801:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908807:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908813:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658486.908816:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658486.908819:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658486.908824:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb21d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658486.908907:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:10554:x1875544076502784:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 623us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658486.908916:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:0.0:1788658486.963083:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658486.963448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076503040 00000100:00100000:3.0:1788658486.963462:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076503040 00000100:00100000:3.0:1788658486.964133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 102 00000100:00100000:3.0:1788658486.964150:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:10557:x1875544076503040:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658486.964180:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658486.964210:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aec8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964312:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964331:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964344:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964382:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964390:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964398:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964607:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964616:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964623:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658486.964635:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788658486.964793:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964802:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964809:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964816:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658486.964822:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964857:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964873:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:3.0:1788658486.964876:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658486.964883:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964890:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb22b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964908:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964913:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964919:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964924:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658486.964927:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964933:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964940:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810f00) 00010000:00010000:3.0:1788658486.964943:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658486.964946:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.964962:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.965015:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.965030:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658486.965038:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:3.0:1788658486.965041:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658486.965044:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658486.965131:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:10557:x1875544076503040:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 986us (2063us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788658486.965140:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 102 00000100:00100000:1.0:1788658486.970080:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658486.970176:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076503168 00000100:00100000:2.0:1788658486.970189:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076503168 00000100:00100000:2.0:1788658486.970259:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:2.0:1788658486.970272:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:10557:x1875544076503168:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1788658486.970359:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970399:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970414:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970449:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970456:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970464:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970471:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658486.970476:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970485:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970499:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658486.970827:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658486.970836:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658486.970845:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658486.970977:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:10557:x1875544076503168:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 707us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658486.970993:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:0.0:1788658486.975245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658486.975356:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076503424 00000100:00100000:1.0:1788658486.975369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076503424 00000100:00100000:1.0:1788658486.975449:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1788658486.975461:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:10557:x1875544076503424:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658486.975846:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10557:x1875544076503424:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 377us (605us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788658486.975855:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00010000:00010000:2.0:1788658487.005220:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658487.062405:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.062581:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076503680 00000100:00100000:2.0:1788658487.062595:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076503680 00000100:00100000:2.0:1788658487.062743:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:2.0:1788658487.062755:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10568:x1875544076503680:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1788658487.062789:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658487.062793:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788658487.062839:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb1c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeac expref: 51 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.062863:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658487.062870:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658487.062887:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb24e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aecf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.063020:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.063037:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.063047:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.063094:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.063134:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 51 pid: 5839 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.063149:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570052b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103781888:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658487.063255:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8dd600 going to sleep for 11 seconds 00000100:00080000:0.0:1788658487.064165:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658487.067721:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.068006:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570052b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103781888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658487.068045:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.068172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076503808 00000100:00100000:0.0:1788658487.068181:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076503808 00010000:00010000:0.0:1788658487.068228:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 52 pid: 5839 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.068276:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1788658487.068287:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:2352:x1875544076503808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658487.068306:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658487.068313:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 52 pid: 5839 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.068327:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 52 pid: 5839 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.068354:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb239 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec8 expref: 52 pid: 5839 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.068372:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.068377:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.068389:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.068399:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.068448:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658487.068545:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:2352:x1875544076503808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 259us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.068553:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00010000:00010000:2.0:1788658487.069637:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.069652:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658487.069701:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788658487.069983:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb24e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.070005:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.070014:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658487.070017:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658487.070021:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891bc00, rc 0) 00000100:00100000:2.0:1788658487.070132:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10568:x1875544076503680:12345-192.168.202.3@tcp:101:bash.0 Request processed in 7379us (7741us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788658487.070142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:2.0:1788658487.076507:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.076733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076504064 00000100:00100000:3.0:1788658487.076748:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076504064 00000100:00100000:3.0:1788658487.076832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 105 00000100:00100000:3.0:1788658487.076846:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:10568:x1875544076504064:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:3.0:1788658487.077220:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.077244:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.077260:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658487.077347:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1788658487.077376:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000995cd1b5 reply state 00000000bd737872 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.077386:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658487.077501:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10568:x1875544076504064:12345-192.168.202.3@tcp:36:bash.0 Request processed in 658us (1008us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788658487.077509:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 105 00000020:00080000:3.0:1788658487.077524:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788658487.080054:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.080074:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.080082:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.080088:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658487.080094:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.080103:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.080123:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658487.080126:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658487.080131:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.080137:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb263 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.082226:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.082325:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076504192 00000100:00100000:0.0:1788658487.082338:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076504192 00000100:00100000:0.0:1788658487.082418:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 106 00000100:00100000:0.0:1788658487.082430:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10568:x1875544076504192:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658487.082465:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658487.082494:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb26a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aed6 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.082616:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.082633:0:11367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.082642:0:11367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.082717:0:11367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.082733:0:11367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 54 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.082751:0:11367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac63100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103782016:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658487.082893:0:11367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c38d0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658487.089231:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.089386:0:11367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac63100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103782016:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658487.089424:0:11367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.089526:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076504320 00000100:00100000:2.0:1788658487.089536:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076504320 00010000:00010000:2.0:1788658487.089584:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 55 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.089633:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:2.0:1788658487.089644:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:2351:x1875544076504320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658487.089711:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658487.089719:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 55 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.089734:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 55 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.089760:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb255 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aecf expref: 55 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.089781:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658487.089787:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.089797:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.089805:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.089845:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658487.089920:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:2351:x1875544076504320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 277us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.089929:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00010000:00010000:0.0:1788658487.090054:0:11367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.090063:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658487.090124:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788658487.090130:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658487.090156:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.090197:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb26a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 54 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.090213:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 53 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.090221:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.090224:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658487.090226:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78a00, rc 0) 00000100:00100000:0.0:1788658487.090254:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10568:x1875544076504192:12345-192.168.202.3@tcp:101:bash.0 Request processed in 7828us (8044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.090261:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 106 00000100:00100000:1.0:1788658487.096566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.096710:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076504576 00000100:00100000:3.0:1788658487.096723:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076504576 00000100:00100000:3.0:1788658487.096860:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:3.0:1788658487.096871:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:10568:x1875544076504576:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:3.0:1788658487.097185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10568:x1875544076504576:12345-192.168.202.3@tcp:35:bash.0 Request processed in 315us (632us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788658487.097193:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:3.0:1788658487.162078:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.162223:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076504704 00000100:00100000:2.0:1788658487.162237:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076504704 00000100:00100000:2.0:1788658487.162328:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 107 00000100:00100000:2.0:1788658487.162339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:10574:x1875544076504704:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658487.162398:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658487.162425:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aedd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.162531:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb27f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.162550:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb27f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.162564:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb27f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658487.162610:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788658487.162615:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658487.162639:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb27f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.162711:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aedd expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.162734:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb27f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aedd expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.162745:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658487.162748:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658487.162752:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a000, rc 0) 00000100:00100000:2.0:1788658487.162835:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:10574:x1875544076504704:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 497us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.162842:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 107 00000100:00100000:1.0:1788658487.166943:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.167048:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076504832 00000100:00100000:0.0:1788658487.167077:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076504832 00000100:00100000:0.0:1788658487.167146:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:0.0:1788658487.167158:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:10574:x1875544076504832:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658487.167185:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658487.167214:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb286 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aee4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167311:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167331:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167344:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167361:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167368:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167374:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167496:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb29b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167850:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167861:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658487.167917:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788658487.167923:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658487.167946:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167961:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167971:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167979:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167986:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.167993:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658487.167999:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168007:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168022:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:0.0:1788658487.168025:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658487.168031:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168039:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb28d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168067:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168074:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168080:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168085:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658487.168088:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168095:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168103:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56c3c69000) 00010000:00010000:0.0:1788658487.168105:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658487.168108:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168114:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168155:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aee4 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168171:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aee4 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.168191:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.168194:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658487.168197:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78800, rc 0) 00000100:00100000:0.0:1788658487.168343:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10574:x1875544076504832:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1186us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.168352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:1.0:1788658487.175059:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.175145:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.175263:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076505216 00000100:00100000:2.0:1788658487.175276:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076505216 00000100:00100000:2.0:1788658487.175364:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1788658487.175376:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:2352:x1875544076505216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658487.175396:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658487.175428:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb29b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aee4 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.175453:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658487.175460:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658487.175707:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:2352:x1875544076505216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 332us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.175716:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658487.176238:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076505088 00000100:00100000:0.0:1788658487.176245:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076505088 00000100:00100000:0.0:1788658487.176319:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:0.0:1788658487.176330:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:10574:x1875544076505088:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658487.176352:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658487.176374:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb2a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aeeb expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.176493:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.177426:0:11367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 56 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.177441:0:11367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.177496:0:11367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 56 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.177601:0:11367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 56 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.177637:0:11367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac63100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103782144:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658487.177918:0:11367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c38d0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658487.182229:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.182451:0:11367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac63100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103782144:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658487.182488:0:11367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.182655:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076505344 00000100:00100000:2.0:1788658487.182749:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076505344 00010000:00010000:2.0:1788658487.182800:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 57 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.182967:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:2.0:1788658487.182979:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8935450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:2351:x1875544076505344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658487.182998:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658487.183006:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 57 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.183020:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 57 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.183065:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aed6 expref: 57 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.183084:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658487.183089:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.183100:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.183109:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.183141:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658487.183211:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8935450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:2351:x1875544076505344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 235us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.183220:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00010000:00010000:0.0:1788658487.183930:0:11367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.183943:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658487.183969:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788658487.184178:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb2a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 57 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.184197:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 56 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.184205:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.184208:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658487.184211:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78200, rc 0) 00000100:00100000:0.0:1788658487.184285:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10574:x1875544076505088:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7948us (9233us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788658487.184293:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:3.0:1788658487.188221:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.188784:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076505600 00000100:00100000:1.0:1788658487.188799:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076505600 00000100:00100000:1.0:1788658487.188901:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658487.188913:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10574:x1875544076505600:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:1.0:1788658487.188934:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658487.188967:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aec1 expref: 56 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.188993:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:1.0:1788658487.189000:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658487.189071:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:10574:x1875544076505600:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 160us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658487.189078:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1788658487.191262:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.192073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076505728 00000100:00100000:1.0:1788658487.192088:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076505728 00000100:00100000:1.0:1788658487.192185:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:1.0:1788658487.192198:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:10574:x1875544076505728:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:1.0:1788658487.192373:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.192396:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.192410:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658487.192772:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788658487.192913:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:10574:x1875544076505728:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 717us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658487.192929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:3.0:1788658487.195561:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.196260:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076505856 00000100:00100000:2.0:1788658487.196281:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076505856 00000100:00100000:2.0:1788658487.196357:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 111 00000100:00100000:2.0:1788658487.196369:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:10574:x1875544076505856:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658487.196394:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658487.196422:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aef2 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.196512:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.196547:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 56 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.196571:0:6710:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.196588:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 56 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.196605:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658487.196608:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658487.196612:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 56 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.196621:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891bc00, rc 0) 00000100:00100000:2.0:1788658487.196743:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10574:x1875544076505856:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 377us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.196750:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 111 00000040:00080000:1.0:1788658487.261041:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658487.261057:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658487.261110:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788658487.261120:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658487.262542:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5733480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103782272:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658487.262983:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658487.275225:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5733480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103782272:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788658487.277574:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.277731:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076505984 00000100:00100000:0.0:1788658487.277760:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076505984 00000100:00100000:0.0:1788658487.277838:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 112 00000100:00100000:0.0:1788658487.277850:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10575:x1875544076505984:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788658487.277896:0:11367:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788658487.278047:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10575:x1875544076505984:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 198us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.278055:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 112 00000100:00100000:3.0:1788658487.282244:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.282545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076506112 00000100:00100000:1.0:1788658487.282559:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076506112 00000100:00100000:1.0:1788658487.282638:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:1.0:1788658487.282650:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10575:x1875544076506112:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788658487.282819:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.282841:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.282856:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287033:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287060:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287074:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287128:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287138:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287145:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658487.287194:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788658487.287199:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658487.287212:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287224:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287231:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287237:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287243:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658487.287247:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287254:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287266:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:1.0:1788658487.287276:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658487.287283:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287291:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb2c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287307:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287313:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287319:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287324:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658487.287327:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287333:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287341:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9e56c3c59400) 00010000:00010000:1.0:1788658487.287343:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658487.287346:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287351:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb2cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287369:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287381:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287386:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287390:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658487.287393:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287398:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287406:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:1.0:1788658487.287408:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658487.287411:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.287416:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb2d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658487.288213:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10575:x1875544076506112:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 5557us (5974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658487.288225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:3.0:1788658487.304242:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.304477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076506368 00000100:00100000:0.0:1788658487.304504:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076506368 00000100:00100000:0.0:1788658487.304584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:0.0:1788658487.304596:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:10575:x1875544076506368:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658487.304627:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658487.304657:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb2da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aef9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.304832:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.304851:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.304867:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658487.304882:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788658487.305029:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305037:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305068:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305075:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658487.305082:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305091:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305109:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.305113:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788658487.305119:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305126:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb2e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305180:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb2da lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef9 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305192:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:0.0:1788658487.305195:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658487.305199:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb2da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef9 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.305208:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658487.305552:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10575:x1875544076506368:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 956us (1324us total) trans 4294967398 rc 301/301 00000100:00100000:0.0:1788658487.305571:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:2.0:1788658487.313602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.317541:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076506496 00000100:00100000:0.0:1788658487.317563:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076506496 00000100:00100000:0.0:1788658487.317751:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:0.0:1788658487.317766:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10575:x1875544076506496:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788658487.317831:0:11367:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788658487.317991:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10575:x1875544076506496:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 227us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.318005:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:1.0:1788658487.329312:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.333619:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076506752 00000100:00100000:2.0:1788658487.333642:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076506752 00000100:00100000:2.0:1788658487.333742:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:2.0:1788658487.333756:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10575:x1875544076506752:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658487.333783:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658487.333788:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788658487.333854:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb27f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aedd expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.333881:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658487.333888:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658487.333908:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb2ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af00 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658487.337902:0:6710:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788658487.338624:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb2f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.338651:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.338689:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.338784:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb2ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af00 expref: 59 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.339708:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af00 expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.339722:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d579c900) 00010000:00010000:2.0:1788658487.339725:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658487.339731:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a800, rc 0) 00000100:00100000:2.0:1788658487.339848:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10575:x1875544076506752:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 6094us (10550us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788658487.339881:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:3.0:1788658487.343789:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.343916:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076507008 00000100:00100000:2.0:1788658487.343929:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076507008 00000100:00100000:2.0:1788658487.344004:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:2.0:1788658487.344016:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10575:x1875544076507008:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658487.344098:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658487.344134:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb2f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af00 expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344158:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d579c900) 00010000:00010000:2.0:1788658487.344173:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658487.344200:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344217:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344229:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344396:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344426:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344506:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344605:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344612:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344618:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344623:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658487.344627:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344635:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344646:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658487.344649:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658487.344653:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344658:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb304 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344902:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344911:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344916:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344928:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658487.344932:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344938:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344946:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcb73d834 (ffff9e56d579c800) 00010000:00010000:2.0:1788658487.344948:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658487.344951:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.344956:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb30b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcb73d834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.345153:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10575:x1875544076507008:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1133us (1372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658487.345163:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:0.0:1788658487.353560:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.353818:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076507136 00000100:00100000:2.0:1788658487.353841:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076507136 00000100:00100000:3.0:1788658487.354229:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:3.0:1788658487.354246:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:10575:x1875544076507136:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658487.354346:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658487.354392:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb312 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af07 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.354446:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.354465:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.354479:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.354621:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 59 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.354644:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 58 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.354654:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:3.0:1788658487.354657:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658487.354661:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef600, rc 0) 00000100:00100000:3.0:1788658487.354847:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10575:x1875544076507136:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 604us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658487.354857:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:1.0:1788658487.358929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.360898:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076507392 00000100:00100000:2.0:1788658487.360919:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076507392 00000100:00100000:2.0:1788658487.361005:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:2.0:1788658487.361018:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:10575:x1875544076507392:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658487.361114:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.361135:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.361167:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658487.361456:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788658487.361469:0:6710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378500802618ns, next at 379500798555ns, rc = 0 00000004:00010000:2.0:1788658487.361577:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f78664b reply state 000000003ef6de77 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.361588:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658487.361735:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:10575:x1875544076507392:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 718us (2822us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788658487.361744:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 119 00010000:00010000:1.0:1788658487.369739:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.369765:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.369804:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.369812:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658487.369818:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.369828:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.369851:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:1.0:1788658487.369855:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788658487.369862:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.369869:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb320 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658487.373304:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.373581:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076507520 00000100:00100000:3.0:1788658487.373596:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076507520 00000100:00100000:3.0:1788658487.373709:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:3.0:1788658487.373725:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:10575:x1875544076507520:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658487.373768:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658487.373828:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.373923:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.373943:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.373969:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:3.0:1788658487.373973:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658487.373978:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:3.0:1788658487.374083:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:10575:x1875544076507520:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 362us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658487.374091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:0.0:1788658487.380508:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.380606:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076507648 00000100:00100000:1.0:1788658487.380621:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076507648 00000100:00100000:1.0:1788658487.380763:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:1.0:1788658487.380777:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2351:x1875544076507648:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788658487.381186:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2351:x1875544076507648:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 411us (701us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788658487.381196:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00080000:0.0:1788658487.381277:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658487.393312:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.393474:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076507904 00000100:00100000:0.0:1788658487.393498:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076507904 00000100:00100000:0.0:1788658487.393585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658487.393596:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:10575:x1875544076507904:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788658487.393966:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:10575:x1875544076507904:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 371us (669us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788658487.393975:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:2.0:1788658487.399281:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.399537:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076508160 00000100:00100000:3.0:1788658487.399551:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076508160 00000100:00100000:3.0:1788658487.399631:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:3.0:1788658487.399644:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:10575:x1875544076508160:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788658487.399847:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:10575:x1875544076508160:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 204us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658487.399855:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:1.0:1788658487.403230:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.407449:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076508288 00000100:00100000:0.0:1788658487.407474:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076508288 00000100:00100000:0.0:1788658487.407594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:0.0:1788658487.407607:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:10575:x1875544076508288:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658487.407637:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658487.407700:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb32e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af15 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.407830:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb335 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.407851:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.407866:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658487.407921:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658487.407949:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.407986:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb32e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af15 expref: 63 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.408025:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af15 expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.408036:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:0.0:1788658487.408039:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788658487.408044:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78c00, rc 0) 00000100:00100000:0.0:1788658487.408144:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:10575:x1875544076508288:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 540us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.408152:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:0.0:1788658487.412202:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.412279:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076508416 00000100:00100000:3.0:1788658487.412289:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076508416 00000100:00100000:3.0:1788658487.412377:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1788658487.412388:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2352:x1875544076508416:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658487.412407:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658487.412456:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af1c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658487.412496:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc337, blocks: 0x1 00010000:00010000:3.0:1788658487.412521:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1788658487.412527:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658487.412537:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.412555:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.412570:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee400, rc 0) 00000100:00100000:3.0:1788658487.412640:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2352:x1875544076508416:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 253us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658487.412647:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1788658487.426742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.430972:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076508672 00000100:00100000:3.0:1788658487.430989:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076508672 00000100:00100000:3.0:1788658487.431067:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:3.0:1788658487.431079:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:10575:x1875544076508672:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788658487.431209:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:10575:x1875544076508672:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 132us (4478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658487.431217:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:1.0:1788658487.440773:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.440931:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076508800 00000100:00100000:0.0:1788658487.440942:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076508800 00000100:00100000:0.0:1788658487.441013:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:0.0:1788658487.441023:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:10575:x1875544076508800:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658487.441042:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658487.441063:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.441096:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.441106:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658487.441111:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658487.441129:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.441166:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.441180:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 11 pid: 6685 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.441194:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103782400:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658487.441294:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c38d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658487.446657:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103782400:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658487.446736:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.446782:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79e00, rc 0) 00000100:00100000:0.0:1788658487.446841:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+11:10575:x1875544076508800:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 5818us (6077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.446850:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1788658487.450873:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.451017:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076508928 00000100:00100000:1.0:1788658487.451026:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076508928 00010000:00010000:1.0:1788658487.451064:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 11 pid: 6685 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658487.451111:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:1.0:1788658487.451121:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+11:2352:x1875544076508928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658487.451137:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658487.451160:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 11 pid: 6685 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.451174:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 11 pid: 6685 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.451198:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650eb33c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af1c expref: 11 pid: 6685 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.451215:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658487.451219:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658487.451229:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.451239:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.451295:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658487.451326:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875544103782528:192.168.202.3@tcp:105: 00000100:00100000:1.0:1788658487.451409:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fef213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658487.462484:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.462594:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076509056 00000100:00100000:0.0:1788658487.462609:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076509056 00002000:00100000:0.0:1788658487.462720:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e56c5733100 x1875544076509056/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:78/0 lens 504/0 e 0 to 0 dl 1788658498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658487.462732:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56c5733100 with x1875544076509056 ext(0->12) 00002000:00010000:0.0:1788658487.462738:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56c5733100 00000100:00100000:0.0:1788658487.462766:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:0.0:1788658487.462776:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+11:2351:x1875544076509056:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788658487.463314:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2351:x1875544076509056:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 537us (847us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788658487.463323:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00002000:00100000:0.0:1788658487.463331:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e56c5733100 x1875544076509056/t4294967308(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:78/0 lens 504/448 e 0 to 0 dl 1788658498 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658487.463339:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56c5733100 with x1875544076509056 ext(0->12) 00002000:00010000:0.0:1788658487.463343:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56c5733100 00000100:00100000:2.0:1788658487.463533:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875544103782528:192.168.202.3@tcp:105: 00010000:00010000:2.0:1788658487.463560:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658487.463586:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:2352:x1875544076508928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 12467us (12722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.463594:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:0.0:1788658487.474452:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.474538:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076509184 00000100:00100000:2.0:1788658487.474549:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076509184 00000100:00100000:2.0:1788658487.474608:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:2.0:1788658487.474618:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:10575:x1875544076509184:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788658487.623035:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:10575:x1875544076509184:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 148398us (148574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.623087:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 124 00000001:00080000:1.0:1788658487.623415:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1788658487.623445:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788658487.623525:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788658487.623554:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788658487.623570:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788658487.623588:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56de8dd480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788658487.623593:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56efb07500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56de8dde40 00000020:00080000:1.0:1788658487.623597:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56efb07900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e56faf9c000 00000020:00080000:1.0:1788658487.623621:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56de8dd9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788658487.623624:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56efb07e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56de8dd840 00000020:00080000:1.0:1788658487.623627:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56efb07800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e56feff0800 00000020:00080000:1.0:1788658487.623721:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788658487.624024:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788658487.624852:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658487.624878:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103782656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788658487.624956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658487.625038:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570052a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103782784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788658487.625070:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658487.625095:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658487.625100:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103782912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788658487.625124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658487.626069:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103782656 00000100:00100000:0.0:1788658487.626087:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103782656 00000100:00100000:2.0:1788658487.626346:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103782784 00000100:00100000:2.0:1788658487.626352:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103782784 00000100:00100000:0.0:1788658487.626741:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103782912 00000100:00100000:0.0:1788658487.626747:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103782912 00000100:00100000:1.0:1788658487.626813:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658487.626829:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875544103782656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788658487.626875:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788658487.626925:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cc336, atime: 0x0, ctime: 0x6a9cc336, blocks: 0xb 00010000:00010000:1.0:1788658487.626935:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.626954:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1788658487.626974:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658487.626982:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.627004:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.627015:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.627023:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.627045:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788658487.629416:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875544103782656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2577us (4446us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788658487.629438:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658487.630651:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.631787:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076509312 00000100:00100000:2.0:1788658487.631803:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076509312 00000100:00100000:2.0:1788658487.631855:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788658487.631867:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570104e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103782784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788658487.631914:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788658487.631948:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.631974:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.631984:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788658487.631989:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658487.631994:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.632050:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.632068:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 12 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.632085:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570052b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875544103783040:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658487.632424:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8ddc00 going to sleep for 11 seconds 00010000:00010000:2.0:1788658487.632474:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658487.632486:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.632500:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658487.632507:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.632523:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.632731:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.632745:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb34a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.632806:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658487.632810:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658487.632813:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788658487.633958:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788658487.634058:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e56c5730a80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788658487.634073:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c5730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103782656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788658487.634122:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:2.0:1788658487.634143:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:2351:x1875544076509312:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788658487.649203:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.649253:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076509440 00000100:00100000:2.0:1788658487.649266:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076509440 00010000:00010000:2.0:1788658487.649320:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 13 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.649371:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:2.0:1788658487.649383:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2351:x1875544076509440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658487.649402:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658487.649409:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 13 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.649428:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 13 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.649472:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658487.649478:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658487.649486:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.649499:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.649525:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658487.649591:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2351:x1875544076509440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 208us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.649621:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00010000:00010000:3.0:1788658487.650037:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cee0641/0xf657f176650eb10c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae82 expref: 12 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.650074:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570052b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875544103783040:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658487.650110:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.650127:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.650136:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.650152:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.650163:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.650188:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658487.650952:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570104e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1875544103782784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19085us (25878us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788658487.650962:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658487.651159:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658487.651171:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103782912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788658487.651306:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788658487.651310:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788658487 00002000:00010000:3.0:1788658487.651322:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788658487.651324:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788658487 -> 1788658487 00002000:00010000:3.0:1788658487.651327:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788658487.651360:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1875544103782912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (26236us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788658487.651367:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788658487.651813:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658487.651826:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.651838:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658487.651844:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.651858:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.651883:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.651892:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a40c49b3/0xf657f176650eb351 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.651916:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658487.651918:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658487.651920:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788658487.653617:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5700529500/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788658487.653638:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103782912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1788658487.653655:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e570052a300/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788658487.653659:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570052a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103782784:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788658487.696747:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1788658487.696851:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1788658487.697333:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076509312:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 63191us (66797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.697351:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1788658487.702179:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.702324:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076509696 00000100:00100000:2.0:1788658487.702338:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076509696 00000100:00100000:2.0:1788658487.702420:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00100000:2.0:1788658487.702432:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:10575:x1875544076509696:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658487.702529:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658487.702595:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb335 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af15 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.702627:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:2.0:1788658487.702638:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658487.703519:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.703542:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.703556:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658487.703986:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf4a13f2 reply state 000000004c91274b transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.704003:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658487.704196:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:10575:x1875544076509696:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1762us (2027us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788658487.704206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 125 00010000:00010000:2.0:1788658487.709621:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.709645:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.709655:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.709692:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658487.709702:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.709741:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.709793:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:2.0:1788658487.709800:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658487.709810:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.709820:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb358 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.712078:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.712523:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076509824 00000100:00100000:3.0:1788658487.712537:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076509824 00000100:00100000:3.0:1788658487.712692:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1788658487.712706:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076509824:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788658487.713059:0:10289:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788658487.713067:0:10289:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788658487 -> 1788658486 00002000:00010000:3.0:1788658487.713072:0:10289:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788658486 00002000:00010000:3.0:1788658487.713076:0:10289:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788658487 -> 1788658486 00002000:00010000:3.0:1788658487.713079:0:10289:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788658487.713200:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076509824:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 493us (1138us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788658487.713210:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1788658487.717128:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.718101:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076510080 00000100:00100000:0.0:1788658487.718122:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076510080 00000100:00100000:0.0:1788658487.718403:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:0.0:1788658487.718424:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:10575:x1875544076510080:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788658487.718540:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.718560:0:11367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 15 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.718594:0:11367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.721182:0:11367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 15 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.721382:0:11367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 15 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.721407:0:11367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103783168:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658487.721741:0:11367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c20f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658487.725992:0:11367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103783168:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658487.726038:0:11367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.728151:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658487.728535:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076510208 00000100:00100000:2.0:1788658487.728551:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076510208 00010000:00010000:2.0:1788658487.728614:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 16 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.728713:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:2.0:1788658487.728733:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:2351:x1875544076510208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658487.728772:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658487.728785:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 16 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.728808:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 16 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.728846:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af07 expref: 16 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.728909:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:2.0:1788658487.728919:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.728935:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.728948:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.729004:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658487.729338:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:2351:x1875544076510208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 607us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.729349:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00010000:00010000:3.0:1788658487.729916:0:11367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.729952:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.730000:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.730012:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.730023:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.730031:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658487.730040:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.730054:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.730076:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:3.0:1788658487.730080:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788658487.730087:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.730098:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb35f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.730204:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:10575:x1875544076510080:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 11783us (13094us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788658487.730218:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:0.0:1788658487.739072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.739312:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076510336 00000100:00100000:3.0:1788658487.739327:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076510336 00000100:00100000:3.0:1788658487.739401:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:3.0:1788658487.739414:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2354:x1875544076510336:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788658487.739490:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.739520:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.739531:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658487.739536:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658487.739542:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.739590:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.739607:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 7 pid: 6686 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.739624:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875544103783296:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658487.739946:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f4500a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658487.744344:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.744435:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076510464 00000100:00100000:0.0:1788658487.744458:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076510464 00010000:00010000:0.0:1788658487.744516:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 8 pid: 6686 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.744569:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:0.0:1788658487.744582:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076510464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658487.744601:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658487.744631:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 8 pid: 6686 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.744648:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 8 pid: 6686 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.744732:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658487.744738:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658487.744752:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.744764:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.744791:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658487.744868:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076510464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 288us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.744877:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00010000:00010000:3.0:1788658487.747481:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650eb343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af23 expref: 7 pid: 6686 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.747514:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875544103783296:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658487.747575:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747590:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747598:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747643:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747651:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747661:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747723:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658487.747728:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747738:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747771:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.747785:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650eb366 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.747891:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076510336:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 8478us (8833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658487.747901:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:2.0:1788658487.751877:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.752101:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076510720 00000100:00100000:0.0:1788658487.752116:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076510720 00000100:00100000:0.0:1788658487.752205:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 127 00000100:00100000:0.0:1788658487.752228:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:10575:x1875544076510720:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788658487.752610:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.752632:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.752646:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.754761:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.754795:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.754806:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.754864:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.754885:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 15 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.754924:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d70700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103783424:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658487.755474:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658487.759401:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d70700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103783424:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658487.759461:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658487.764805:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658487.767194:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076510848 00000100:00100000:1.0:1788658487.767267:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076510848 00010000:00010000:1.0:1788658487.767411:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 16 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658487.767542:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:1.0:1788658487.767554:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:2352:x1875544076510848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658487.767575:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658487.767583:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 16 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.767624:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 16 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.767654:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af0e expref: 16 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.767695:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:1.0:1788658487.767703:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.767714:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.767723:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658487.767781:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658487.767868:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:2352:x1875544076510848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 315us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658487.767876:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00010000:00010000:3.0:1788658487.767944:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.767954:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658487.768225:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788658487.768431:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788658487.768500:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788658487.768608:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103783552:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788658487.768733:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658487.768781:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f454e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658487.770772:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103783552 00000100:00100000:0.0:1788658487.770794:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103783552 00000100:00100000:0.0:1788658487.770900:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658487.770913:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6710:x1875544103783552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788658487.771093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6710:x1875544103783552:12345-0@lo:1000:mdt00_003.0 Request processed in 183us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.771102:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658487.771390:0:6710:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788658487.771398:0:6710:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1788658487.771448:0:6710:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e570052a300 x1875544103782784/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788658503 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658487.771464:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103783552:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788658487.772116:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788658487.773083:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103783680:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788658487.773176:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658487.773332:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c20b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658487.773446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103783680 00000100:00100000:1.0:1788658487.773456:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103783680 00000100:00100000:1.0:1788658487.773567:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658487.773579:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6710:x1875544103783680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788658487.773920:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6710:x1875544103783680:12345-0@lo:1000:mdt00_003.0 Request processed in 342us (742us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788658487.773930:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658487.774050:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103783680:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788658487.774098:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774110:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774118:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774124:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658487.774129:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774137:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774157:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810f00) 00010000:00010000:0.0:1788658487.774160:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658487.774166:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774185:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb374 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774237:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774244:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774249:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774253:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658487.774255:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774261:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774270:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.774272:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658487.774281:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774297:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774316:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.774364:0:6710:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.774378:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103783808:192.168.202.3@tcp:105: 00000100:00100000:0.0:1788658487.774499:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c20b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658487.781627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.781762:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076510976 00000100:00100000:3.0:1788658487.781776:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076510976 00000100:00100000:3.0:1788658487.781875:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:3.0:1788658487.781888:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:10574:x1875544076510976:12345-192.168.202.3@tcp:49:lfs.0 00000100:00100000:3.0:1788658487.782074:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:10574:x1875544076510976:12345-192.168.202.3@tcp:49:lfs.0 Request processed in 188us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658487.782082:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1788658487.785735:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103783808:192.168.202.3@tcp:105: 00010000:00010000:0.0:1788658487.786057:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786071:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb2b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786127:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786145:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786160:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786171:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786178:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786185:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786224:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658487.786230:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786239:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786254:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.786257:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658487.786261:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786267:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb37b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786279:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786284:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786291:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786296:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658487.786299:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786316:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786339:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.786341:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658487.786345:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.786351:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb36d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.786798:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:10575:x1875544076510720:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 34576us (34932us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1788658487.786812:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 127 00000020:00080000:0.0:1788658487.786819:0:6710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788658487.787448:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658487.787456:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658487.788095:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788658487.788111:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658487.791992:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.792096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076511232 00000100:00100000:3.0:1788658487.792111:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076511232 00000100:00100000:3.0:1788658487.792194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:3.0:1788658487.792207:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:10574:x1875544076511232:12345-192.168.202.3@tcp:58:lfs.0 00000040:00080000:2.0:1788658487.793216:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788658487.793360:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:10574:x1875544076511232:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 1151us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.793372:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:2.0:1788658487.799942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.800733:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076511488 00000100:00100000:3.0:1788658487.800761:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076511488 00000100:00100000:3.0:1788658487.800850:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:3.0:1788658487.800862:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:10575:x1875544076511488:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788658487.801812:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788658487.801952:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1788658487.802019:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.802042:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.802057:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.802069:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.802076:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.802091:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.802125:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658487.802273:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:10575:x1875544076511488:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 1408us (2341us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788658487.802284:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000020:00080000:3.0:1788658487.802290:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788658487.802720:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658487.802730:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.802738:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658487.802743:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.802753:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.802769:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e56d0810e00) 00010000:00010000:2.0:1788658487.802773:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788658487.802790:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.802797:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb382 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.802822:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658487.802824:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658487.802826:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658487.840870:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.840969:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076511616 00000100:00100000:3.0:1788658487.840983:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076511616 00000100:00100000:3.0:1788658487.841048:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 129 00000100:00100000:3.0:1788658487.841058:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:10577:x1875544076511616:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658487.841090:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658487.841115:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af2a expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841204:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841224:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841239:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841259:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841267:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841297:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841630:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841640:0:11367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 21 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841647:0:11367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841715:0:11367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 21 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658487.841728:0:11367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 21 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658487.842476:0:11367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103783936:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658487.842973:0:11367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f58300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658487.850788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658487.851209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076511872 00000100:00100000:3.0:1788658487.851224:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076511872 00000100:00100000:3.0:1788658487.851311:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:3.0:1788658487.851323:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:5590:x1875544076511872:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788658487.851842:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:5590:x1875544076511872:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 519us (1064us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788658487.851850:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:0.0:1788658487.852329:0:11367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103783936:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658487.852368:0:11367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658487.864255:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658487.864409:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076512000 00000100:00100000:0.0:1788658487.864467:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076512000 00010000:00010000:0.0:1788658487.864536:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 23 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.864579:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1788658487.864593:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8934050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:2351:x1875544076512000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658487.864615:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658487.864622:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 23 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.864657:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 23 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.864719:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb2a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aeeb expref: 23 pid: 11367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.864743:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658487.864751:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.864763:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.864772:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658487.864810:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658487.864849:0:11367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.864859:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658487.864892:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8934050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:2351:x1875544076512000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 301us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.864899:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000004:00200000:2.0:1788658487.864918:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788658487.864923:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658487.864949:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.864966:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.864978:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.864985:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.864992:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.865011:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eee00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658487.865017:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.865027:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.866884:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:2.0:1788658487.866901:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658487.866916:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.866930:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.866959:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.866966:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.866973:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.866978:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658487.866983:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.866992:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.867038:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e56d0810c00) 00010000:00010000:2.0:1788658487.867041:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658487.867044:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.867050:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.867401:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af2a expref: 22 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.867503:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af2a expref: 21 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658487.867512:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:2.0:1788658487.867515:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658487.867518:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efc00, rc 0) 00000100:00100000:2.0:1788658487.867660:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10577:x1875544076511616:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 26600us (26803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658487.867701:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 129 00010000:00010000:3.0:1788658488.030536:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658488.815739:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658488.815752:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658488.815807:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788658488.815815:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658488.815979:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d72680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103784064:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788658488.816116:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658488.820827:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d72680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103784064:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788658488.821626:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658488.821974:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076512128 00000100:00100000:1.0:1788658488.821985:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076512128 00000100:00100000:1.0:1788658488.822063:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 130 00000100:00100000:1.0:1788658488.822075:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10588:x1875544076512128:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658488.822128:0:6710:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658488.822258:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10588:x1875544076512128:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 185us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658488.822268:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 130 00000100:00100000:3.0:1788658488.825653:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658488.829513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076512384 00000100:00100000:1.0:1788658488.829534:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076512384 00000100:00100000:1.0:1788658488.829624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 131 00000100:00100000:1.0:1788658488.829637:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:10588:x1875544076512384:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658488.829695:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658488.829724:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb3a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af31 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.829860:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb3ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.829881:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb3ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.829914:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb3ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658488.829930:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788658488.830890:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678600/0xf657f176650eb3a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af31 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.830920:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb3ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af31 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.830931:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:1.0:1788658488.830934:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658488.830939:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679800, rc 0) 00000100:00100000:1.0:1788658488.831104:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:10588:x1875544076512384:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1468us (5466us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788658488.831114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 131 00000100:00100000:3.0:1788658488.843953:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658488.844045:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076512640 00000100:00100000:0.0:1788658488.844067:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076512640 00000100:00100000:0.0:1788658488.844164:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 132 00000100:00100000:0.0:1788658488.844179:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:10588:x1875544076512640:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788658488.844310:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844343:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844375:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844654:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844698:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844707:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844712:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658488.844718:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844726:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844741:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658488.844745:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658488.844750:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.844761:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658488.844983:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:10588:x1875544076512640:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 805us (1043us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788658488.844993:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 132 00000040:00080000:3.0:1788658488.845103:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658488.845111:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788658488.845867:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788658488.845881:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658488.846745:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658488.847023:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076512768 00000100:00100000:3.0:1788658488.847036:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076512768 00000100:00100000:3.0:1788658488.847117:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1788658488.847134:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:2354:x1875544076512768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658488.847154:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658488.847183:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679800/0xf657f176650eb3ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af31 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658488.847204:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:3.0:1788658488.847209:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658488.847281:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:2354:x1875544076512768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 152us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658488.847288:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1788658488.849389:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658488.849461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076513024 00000100:00100000:2.0:1788658488.849481:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076513024 00000100:00100000:2.0:1788658488.849630:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:2.0:1788658488.849646:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:10588:x1875544076513024:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658488.850172:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:10588:x1875544076513024:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 529us (794us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788658488.852893:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000040:00080000:1.0:1788658488.861897:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658488.861907:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658488.861967:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788658488.861976:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788658489.055326:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658489.115603:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658489.119974:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076513280 00000100:00100000:3.0:1788658489.119996:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076513280 00000100:00100000:3.0:1788658489.120181:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00100000:3.0:1788658489.120195:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:10601:x1875544076513280:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658489.120229:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658489.120259:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb3c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af38 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658489.120434:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb3c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658489.120452:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658489.120465:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658489.120476:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788658489.120630:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb3c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af38 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658489.120651:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af38 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658489.120660:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:3.0:1788658489.120713:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788658489.120718:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef400, rc 0) 00000100:00100000:3.0:1788658489.120799:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:10601:x1875544076513280:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 607us (5221us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788658489.120807:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00100000:1.0:1788658489.123747:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658489.123871:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076513408 00000100:00100000:0.0:1788658489.123881:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076513408 00000100:00100000:0.0:1788658489.123938:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 134 00000100:00100000:0.0:1788658489.123948:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:10601:x1875544076513408:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1788658489.124012:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124029:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124041:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124065:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124072:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124079:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124085:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658489.124089:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124097:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124126:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658489.124129:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658489.124135:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658489.124141:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb3d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658489.124214:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:10601:x1875544076513408:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 267us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658489.124220:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 134 00000100:00080000:2.0:1788658489.126968:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658489.235915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658489.236031:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076513536 00000100:00100000:1.0:1788658489.236104:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076513536 00000100:00100000:1.0:1788658489.236246:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:1.0:1788658489.236262:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076513536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1788658489.236294:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658489.236325:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abd7854/0xf657f176650eb3dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af3f expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658489.236374:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cc336, atime: 0x6a9cc336, ctime: 0x6a9cc336, blocks: 0xb 00010000:00010000:1.0:1788658489.236397:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1788658489.236401:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658489.236410:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abd7854/0xf657f176650eb3dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af3f expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658489.236430:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009abd7854/0xf657f176650eb3dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af3f expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658489.236443:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679800, rc 0) 00000100:00100000:1.0:1788658489.236515:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2354:x1875544076513536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 259us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658489.236524:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00080000:2.0:1788658489.236598:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658489.241848:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658489.242691:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076513664 00000100:00100000:0.0:1788658489.242709:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076513664 00002000:00100000:0.0:1788658489.242770:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e57005aad80 x1875544076513664/t0(0) o3->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:80/0 lens 488/0 e 0 to 0 dl 1788658500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658489.242783:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e57005aad80 with x1875544076513664 ext(0->4095) 00002000:00010000:0.0:1788658489.242789:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e57005aad80 00000100:00100000:0.0:1788658489.242836:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:0.0:1788658489.242846:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076513664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1788658489.243110:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076513664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 264us (1277us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788658489.243118:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00002000:00100000:0.0:1788658489.243125:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e57005aad80 x1875544076513664/t0(0) o3->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:80/0 lens 488/4536 e 0 to 0 dl 1788658500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658489.243133:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e57005aad80 with x1875544076513664 ext(0->4095) 00002000:00010000:0.0:1788658489.243143:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e57005aad80 00000100:00100000:2.0:1788658489.245051:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103784192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658489.245129:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658489.245292:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103784192 00000100:00100000:1.0:1788658489.245300:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103784192 00000100:00100000:1.0:1788658489.245358:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788658489.245367:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1875544103784192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658489.245403:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658489.245461:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1875544103784192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658489.245468:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788658489.245550:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658489.245552:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103784192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658489.512768:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658489.512815:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658489.512869:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658489.512907:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658489.512925:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076513920 00000100:00100000:0.0:1788658489.512939:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076514176 00000100:00100000:1.0:1788658489.512944:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076513920 00000100:00100000:0.0:1788658489.512950:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076514176 00000100:00100000:2.0:1788658489.513081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076513792 00000100:00100000:2.0:1788658489.513089:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076513792 00000100:00100000:1.0:1788658489.513161:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 137 00000100:00100000:1.0:1788658489.513175:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:2353:x1875544076513920:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658489.513317:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:2353:x1875544076513920:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 143us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658489.513325:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 137 00000100:00100000:1.0:1788658489.513347:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 138 00000100:00100000:1.0:1788658489.513355:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076514176:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658489.513383:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2353:x1875544076514176:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658489.513389:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 138 00000100:00100000:2.0:1788658489.513426:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 289 00000100:00100000:2.0:1788658489.513434:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076513792:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658489.513464:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076513792:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658489.513470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 289 00000100:00100000:3.0:1788658489.513609:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076514048 00000100:00100000:3.0:1788658489.513615:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076514048 00000100:00100000:3.0:1788658489.513701:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:3.0:1788658489.513711:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076514048:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658489.513756:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076514048:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 35us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658489.513763:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00080000:3.0:1788658489.513959:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658489.513965:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658489.761503:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570053a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103784320:0@lo:400:kworker.0 00000100:00100000:3.0:1788658489.761621:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658489.761900:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103784320 00000100:00100000:2.0:1788658489.761911:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103784320 00000100:00100000:2.0:1788658489.761977:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788658489.761987:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103784320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.762620:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103784448:0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.762742:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658489.762822:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658489.762830:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.762856:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658489.762891:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570053b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103784704:0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.762928:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658489.762961:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103784448 00000100:00100000:0.0:1788658489.762978:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103784448 00000100:00100000:0.0:1788658489.763024:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103784576 00000100:00100000:0.0:1788658489.763027:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103784576 00000100:00100000:0.0:1788658489.763057:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103784704 00000100:00100000:0.0:1788658489.763061:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103784704 00000100:00100000:0.0:1788658489.763077:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788658489.763085:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103784448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.763139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103784448:12345-0@lo:400:kworker.0 Request processed in 54us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658489.763146:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788658489.763163:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788658489.763169:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103784576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.763195:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103784576:12345-0@lo:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658489.763227:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788658489.763240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788658489.763245:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103784704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.763280:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875544103784704:12345-0@lo:400:kworker.0 Request processed in 34us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658489.763286:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788658489.763301:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658489.763343:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.763354:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103784448:0@lo:400:kworker.0 00000100:00100000:0.0:1788658489.763387:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570053b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103784704:0@lo:400:kworker.0 00000100:00100000:2.0:1788658489.771959:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103784320:12345-0@lo:400:kworker.0 Request processed in 9957us (10323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658489.771976:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788658489.773233:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570053a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103784320:0@lo:400:kworker.0 00000100:00100000:3.0:1788658489.775512:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103784832:0@lo:400:kworker.0 00000100:00100000:3.0:1788658489.775615:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658489.775717:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103784832 00000100:00100000:0.0:1788658489.775727:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103784832 00000100:00100000:0.0:1788658489.775816:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788658489.775825:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103784832:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788658489.775906:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658489.782359:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103784832:12345-0@lo:400:kworker.0 Request processed in 6517us (6726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658489.782382:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788658489.782698:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103784832:0@lo:400:kworker.0 00010000:00010000:1.0:1788658490.077025:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658490.269267:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658490.269295:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103784960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658490.269382:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658490.269581:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103784960 00000100:00100000:1.0:1788658490.269591:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103784960 00000100:00100000:1.0:1788658490.269684:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788658490.269696:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875544103784960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658490.269744:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658490.269804:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875544103784960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658490.269812:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658490.269915:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103784960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788658491.105237:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788658491.851209:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1788658492.127584:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788658492.882370:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788658492.882389:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788658492.904565:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1788658492.904588:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1788658492.904611:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:2.0:1788658492.904623:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788658492.904639:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56f454ecc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788658492.904644:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff759200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56f454e780 00000020:00080000:2.0:1788658492.904648:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff759500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e56fef30400 00000020:00080000:0.0:1788658492.904731:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788658492.904908:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788658493.148789:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658493.608983:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658493.609313:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076514304 00000100:00100000:0.0:1788658493.609323:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076514304 00000100:00100000:0.0:1788658493.609403:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 135 00000100:00100000:0.0:1788658493.609413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10254:x1875544076514304:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788658493.609519:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10254:x1875544076514304:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 Request processed in 108us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.609543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 135 00000100:00080000:2.0:1788658493.609619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658493.614708:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658493.614873:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076514560 00000100:00100000:0.0:1788658493.614884:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076514560 00000100:00100000:0.0:1788658493.614989:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:0.0:1788658493.614999:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:10254:x1875544076514560:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788658493.615324:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:10254:x1875544076514560:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 326us (672us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788658493.615332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:3.0:1788658493.890907:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658493.891067:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076514688 00000100:00100000:1.0:1788658493.891078:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076514688 00000100:00100000:1.0:1788658493.891280:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 136 00000100:00100000:1.0:1788658493.891291:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:11053:x1875544076514688:12345-192.168.202.3@tcp:101:lsof.0 00010000:00010000:1.0:1788658493.891312:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658493.891334:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af46 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.891415:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.891429:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.891441:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658493.891473:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658493.891477:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658493.891516:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.891540:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.891559:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.891567:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:1.0:1788658493.891570:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658493.891573:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679200, rc 0) 00000100:00100000:1.0:1788658493.891635:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:11053:x1875544076514688:12345-192.168.202.3@tcp:101:lsof.0 Request processed in 346us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.891643:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 136 00000100:00080000:2.0:1788658493.891770:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658494.173146:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658494.368848:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658494.368873:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570053a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103785088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658494.368971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658494.369177:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785088 00000100:00100000:1.0:1788658494.369186:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785088 00000100:00080000:2.0:1788658494.369257:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658494.369262:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788658494.369274:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103785088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658494.369307:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658494.369351:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103785088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658494.369356:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788658494.369453:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788658494.369457:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e570052a300, transno 4294967309 00000004:00080000:3.0:1788658494.369472:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5700529500, transno 4294967310 00000004:00080000:3.0:1788658494.369477:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788658494.369503:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570053a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103785088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658494.632609:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658494.632714:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658494.632762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658494.632804:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658494.634121:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658494.635037:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076515072 00000100:00100000:3.0:1788658494.635056:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076515072 00000100:00100000:3.0:1788658494.635138:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076515200 00000100:00100000:3.0:1788658494.635142:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076515200 00000100:00100000:3.0:1788658494.635252:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:3.0:1788658494.635265:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076515072:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658494.635282:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076515328 00000100:00100000:1.0:1788658494.635287:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076515328 00000100:00100000:1.0:1788658494.635398:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076514944 00000100:00100000:1.0:1788658494.635402:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076514944 00000100:00100000:1.0:1788658494.635775:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:1.0:1788658494.635788:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2354:x1875544076515328:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658494.635881:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076515072:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 617us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.635890:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:3.0:1788658494.635913:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:3.0:1788658494.635921:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076515200:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658494.635949:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2354:x1875544076515200:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.635955:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:3.0:1788658494.636127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 143 00000100:00100000:3.0:1788658494.636136:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2354:x1875544076514944:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658494.636236:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076514816 00000100:00100000:2.0:1788658494.636242:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076514816 00000100:00100000:2.0:1788658494.636285:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 291 00000100:00100000:1.0:1788658494.636393:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2354:x1875544076515328:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 608us (3629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658494.636401:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:3.0:1788658494.636448:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2354:x1875544076514944:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 312us (3641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.636474:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 143 00000100:00080000:0.0:1788658494.637026:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658494.637035:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658494.637184:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076514816:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658494.637249:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2354:x1875544076514816:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 954us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658494.637257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 291 00000100:00100000:3.0:1788658494.877452:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103785344:0@lo:400:kworker.0 00000100:00100000:3.0:1788658494.877728:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658494.877805:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103785856:0@lo:400:kworker.0 00000100:00100000:3.0:1788658494.877848:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658494.877886:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788658494.877893:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103785216:0@lo:400:kworker.0 00000100:00100000:3.0:1788658494.877924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658494.877944:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103785728:0@lo:400:kworker.0 00000100:00100000:3.0:1788658494.877965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658494.877997:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103785600:0@lo:400:kworker.0 00000100:00100000:3.0:1788658494.878021:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658494.878042:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658494.878047:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103785472:0@lo:400:kworker.0 00000100:00100000:3.0:1788658494.878067:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658494.878097:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785856 00000100:00100000:3.0:1788658494.878107:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785856 00000100:00100000:3.0:1788658494.878181:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785600 00000100:00100000:3.0:1788658494.878185:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785600 00000100:00100000:3.0:1788658494.878207:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658494.878216:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103785856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658494.878275:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103785856:12345-0@lo:400:kworker.0 Request processed in 59us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.878283:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658494.878713:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658494.878727:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103785600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658494.878781:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103785600:12345-0@lo:400:kworker.0 Request processed in 60us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658494.878789:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658494.878824:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785344 00000100:00100000:0.0:1788658494.878829:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785344 00000100:00100000:0.0:1788658494.878860:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785728 00000100:00100000:0.0:1788658494.878863:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785728 00000100:00100000:0.0:1788658494.878885:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785472 00000100:00100000:0.0:1788658494.878889:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785472 00000100:00100000:0.0:1788658494.878907:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788658494.878914:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103785344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658494.878971:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103785344:12345-0@lo:400:kworker.0 Request processed in 58us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658494.878979:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788658494.878994:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788658494.879001:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103785728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658494.879028:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103785728:12345-0@lo:400:kworker.0 Request processed in 28us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658494.879034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788658494.879045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788658494.879051:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103785472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658494.879080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103785472:12345-0@lo:400:kworker.0 Request processed in 28us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658494.879086:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788658494.879105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658494.879111:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658494.879468:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785216 00000100:00100000:2.0:1788658494.879475:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785216 00000100:00100000:2.0:1788658494.879530:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788658494.879539:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103785216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658494.879581:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103785216:12345-0@lo:400:kworker.0 Request processed in 43us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658494.879602:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788658494.880230:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103785216:0@lo:400:kworker.0 00000100:00100000:0.0:1788658494.880252:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103785728:0@lo:400:kworker.0 00000100:00100000:0.0:1788658494.880263:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103785344:0@lo:400:kworker.0 00000100:00100000:0.0:1788658494.880276:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788658494.880282:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788658494.880323:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e56c5730a80, transno 4294967304 00000100:00100000:0.0:1788658494.880334:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103785856:0@lo:400:kworker.0 00000100:00100000:2.0:1788658494.886425:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103785472:0@lo:400:kworker.0 00000100:00100000:2.0:1788658494.886451:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103785600:0@lo:400:kworker.0 00010000:00010000:3.0:1788658495.200102:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658495.389074:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103785984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658495.389151:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658495.389286:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103785984 00000100:00100000:2.0:1788658495.389295:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103785984 00000100:00100000:2.0:1788658495.389353:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658495.389364:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103785984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658495.389399:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658495.389448:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103785984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658495.389456:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658495.389502:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103785984:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788658496.029068:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658496.029077:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658496.030131:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788658496.030141:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788658496.220789:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658496.651616:0:12309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:34:55 (1788658495) 00010000:00010000:3.0:1788658497.244982:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658497.772729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658497.772866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076515584 00000100:00100000:0.0:1788658497.772876:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076515584 00000100:00100000:0.0:1788658497.772975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 137 00000100:00100000:0.0:1788658497.772986:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:11318:x1875544076515584:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658497.773008:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658497.773029:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb3f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af4d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773098:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773114:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773126:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773141:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773149:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773155:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773434:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb407 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773444:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773459:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658497.773470:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788658497.773559:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773567:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773574:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773580:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658497.773584:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773591:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773604:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56d579c000) 00010000:00010000:0.0:1788658497.773608:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658497.773612:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773618:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb3f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773630:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773636:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773647:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773653:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658497.773656:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773663:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773724:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e56c3c69b00) 00010000:00010000:0.0:1788658497.773727:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658497.773730:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.773736:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb400 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.774112:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb3f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af4d expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.774127:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb407 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af4d expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.774136:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:0.0:1788658497.774138:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658497.774141:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79800, rc 0) 00000100:00100000:0.0:1788658497.774197:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:11318:x1875544076515584:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1213us (1477us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788658497.774215:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 137 00000100:00080000:2.0:1788658497.774326:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658497.778238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658497.778348:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658497.778474:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076515840 00000100:00100000:1.0:1788658497.778483:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076515840 00000100:00100000:1.0:1788658497.778555:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:1.0:1788658497.778565:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+16:2351:x1875544076515840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658497.778581:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658497.778606:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb407 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af4d expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658497.778623:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:1.0:1788658497.778641:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658497.778718:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:2351:x1875544076515840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 154us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658497.778726:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658497.782931:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076515712 00000100:00100000:2.0:1788658497.782945:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076515712 00000100:00100000:2.0:1788658497.783023:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 138 00000100:00100000:2.0:1788658497.783034:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:11318:x1875544076515712:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788658497.783148:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:11318:x1875544076515712:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 Request processed in 116us (4921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658497.783156:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 138 00000001:00080000:3.0:1788658498.009125:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788658498.009148:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788658498.009441:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788658498.009452:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1788658498.076892:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658498.076902:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658498.076938:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788658498.076947:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788658498.281444:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658499.298544:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658499.489082:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103786112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658499.489169:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658499.489327:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103786112 00000100:00100000:0.0:1788658499.489336:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103786112 00000100:00100000:0.0:1788658499.489389:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788658499.489397:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103786112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658499.489443:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658499.491827:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103786112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2422us (2649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.491840:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788658499.495433:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658499.495632:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103786112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658499.555008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658499.555113:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076515968 00000100:00100000:1.0:1788658499.555123:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076515968 00000100:00100000:1.0:1788658499.555203:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 139 00000100:00100000:1.0:1788658499.555217:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:11360:x1875544076515968:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658499.555238:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658499.555261:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af54 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555326:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555340:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555352:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555367:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555374:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555395:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555605:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555613:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555619:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555625:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658499.555629:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555637:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555648:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:1.0:1788658499.555651:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658499.555655:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555661:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb41c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555697:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555703:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555716:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555721:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658499.555724:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555730:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555738:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e56c3c59000) 00010000:00010000:1.0:1788658499.555741:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658499.555744:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555749:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650eb423 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555783:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb415 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af54 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555792:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:1.0:1788658499.555795:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658499.555798:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af54 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.555808:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679a00, rc 0) 00000100:00100000:1.0:1788658499.555865:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:11360:x1875544076515968:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 652us (866us total) trans 0 rc 301/301 00000100:00100000:1.0:1788658499.555880:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 139 00000100:00080000:3.0:1788658499.556244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658499.565003:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.565108:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076516224 00000100:00100000:0.0:1788658499.565118:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076516224 00000100:00100000:2.0:1788658499.565281:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 140 00000100:00100000:2.0:1788658499.565294:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:11360:x1875544076516224:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1788658499.565354:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658499.565381:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ead93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad8d expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.565413:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658499.565420:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658499.565631:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.565645:0:11367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 5 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.565655:0:11367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.565724:0:11367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 5 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.565738:0:11367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 5 pid: 6710 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658499.565753:0:11367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700529180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103786240:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658499.565838:0:11367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c1254180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658499.568475:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.568646:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076516352 00000100:00100000:0.0:1788658499.568656:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076516352 00010000:00010000:0.0:1788658499.568742:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 6 pid: 6710 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658499.568778:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:0.0:1788658499.568787:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2352:x1875544076516352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658499.568803:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658499.568810:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 6 pid: 6710 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.568835:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 6 pid: 6710 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.568856:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:0.0:1788658499.568861:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.568870:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.568877:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.568894:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658499.568942:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2352:x1875544076516352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 156us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.568948:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00080000:0.0:1788658499.569061:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658499.569391:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb3eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af46 expref: 5 pid: 6710 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658499.569408:0:11367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700529180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103786240:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658499.569429:0:11367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.569438:0:11367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.569443:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.569464:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.569473:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.569480:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658499.570498:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788658499.570511:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.570519:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.570526:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.570542:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658499.570546:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.570555:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.570566:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658499.570568:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658499.570573:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.570578:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb42a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658499.570595:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afe5c913 reply state 00000000d74c3133 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658499.570604:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658499.570696:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:11360:x1875544076516224:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 5404us (5702us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788658499.570703:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 140 00010000:00010000:2.0:1788658499.577753:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.577769:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.577777:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.577800:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658499.577805:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.577813:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.577830:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e56d579c700) 00010000:00010000:2.0:1788658499.577834:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658499.577839:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.577845:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb431 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658499.669764:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658499.669843:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076516480 00000100:00100000:2.0:1788658499.669852:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076516480 00000100:00100000:2.0:1788658499.669899:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 141 00000100:00100000:2.0:1788658499.669909:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:11368:x1875544076516480:12345-192.168.202.3@tcp:101:lctl.0 00010000:00010000:2.0:1788658499.669932:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658499.669953:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af5b expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.670017:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb43f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.670031:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.670059:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658499.670103:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658499.670107:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658499.670127:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.670150:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af5b expref: 15 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.670167:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb43f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af5b expref: 14 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.670357:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:2.0:1788658499.670361:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658499.670365:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b400, rc 0) 00000100:00100000:2.0:1788658499.670421:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:11368:x1875544076516480:12345-192.168.202.3@tcp:101:lctl.0 Request processed in 512us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658499.670429:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 141 00000100:00100000:1.0:1788658499.714217:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.714510:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076516608 00000100:00100000:0.0:1788658499.714522:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076516608 00000100:00100000:0.0:1788658499.714583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:0.0:1788658499.714594:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:11374:x1875544076516608:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658499.714615:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658499.714638:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af62 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.714756:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.714784:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.714796:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.714813:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.714820:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.714827:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.714920:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb45b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715048:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715058:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658499.715097:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788658499.715102:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658499.715135:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715148:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715166:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715173:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715179:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658499.715183:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715190:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715202:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:0.0:1788658499.715204:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658499.715209:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715215:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb44d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715227:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715354:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715363:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715369:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658499.715377:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715383:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715391:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e56c3c69200) 00010000:00010000:0.0:1788658499.715394:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658499.715397:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715403:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715437:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af62 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715450:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb45b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af62 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.715458:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658499.715460:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788658499.715462:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78800, rc 0) 00000100:00100000:0.0:1788658499.715613:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:11374:x1875544076516608:12345-192.168.202.3@tcp:101:bash.0 Request processed in 1021us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.715621:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:3.0:1788658499.724609:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658499.724908:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076516864 00000100:00100000:2.0:1788658499.724918:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076516864 00000100:00100000:2.0:1788658499.725017:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 143 00000100:00100000:2.0:1788658499.725028:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+15:11374:x1875544076516864:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1788658499.725048:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658499.725080:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb462 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af69 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.725236:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.725251:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.725262:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.725331:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.725339:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.725345:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658499.725922:0:11367:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788658499.726091:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726106:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726114:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726146:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726171:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726177:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726182:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658499.726186:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726194:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726206:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658499.726209:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658499.726213:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726219:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb469 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658499.726232:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bd16a61 reply state 00000000a00467bf transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658499.726239:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788658499.726270:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb462 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 18 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726284:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 17 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.726303:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:2.0:1788658499.726305:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658499.726307:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ac00, rc 0) 00000100:00100000:2.0:1788658499.728217:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11374:x1875544076516864:12345-192.168.202.3@tcp:101:bash.0 Request processed in 3180us (3608us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788658499.728229:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 143 00010000:00010000:2.0:1788658499.733893:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.733912:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.733919:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.733925:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658499.733930:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.733937:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.733953:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d579c300) 00010000:00010000:2.0:1788658499.733956:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658499.733960:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.733968:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658499.738237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.738432:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076516992 00000100:00100000:0.0:1788658499.738442:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076516992 00000100:00080000:3.0:1788658499.738696:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658499.738814:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1788658499.738825:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076516992:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658499.738856:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658499.738877:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af70 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658499.738905:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658499.738923:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1788658499.738927:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658499.738937:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.738956:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.738969:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78c00, rc 0) 00000100:00100000:0.0:1788658499.739015:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076516992:12345-192.168.202.3@tcp:101:bash.0 Request processed in 192us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.739021:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:3.0:1788658499.744561:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.744770:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076517120 00000100:00100000:0.0:1788658499.744781:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076517120 00000100:00100000:0.0:1788658499.744839:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1788658499.744850:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:11374:x1875544076517120:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658499.744867:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658499.744886:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af77 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.744916:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.744940:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658499.744944:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658499.744950:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.744979:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.744989:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 7 pid: 6686 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658499.744998:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103786368:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658499.745246:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff9586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658499.749365:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658499.750495:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658499.750636:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076517376 00000100:00100000:2.0:1788658499.750644:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076517376 00000100:00100000:2.0:1788658499.750715:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 293 00000100:00100000:2.0:1788658499.750722:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076517376:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658499.750775:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076517376:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658499.750779:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 293 00000100:00100000:1.0:1788658499.751146:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076517248 00000100:00100000:1.0:1788658499.751152:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076517248 00010000:00010000:1.0:1788658499.751185:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 8 pid: 6686 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658499.751226:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:1.0:1788658499.751234:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2351:x1875544076517248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658499.751245:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658499.751287:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 8 pid: 6686 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.751302:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 8 pid: 6686 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.751329:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658499.751333:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658499.751341:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.751351:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.751388:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658499.751431:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700539180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1875544103786496:192.168.202.3@tcp:105: 00000100:00100000:1.0:1788658499.751486:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d556fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1788658499.752485:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650eb485 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af70 expref: 8 pid: 6686 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658499.752504:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103786368:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658499.752533:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.752546:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658499.752637:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:11374:x1875544076517120:12345-192.168.202.3@tcp:101:bash.0 Request processed in 7789us (8082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.752660:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:3.0:1788658499.760220:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658499.761130:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076517504 00000100:00100000:1.0:1788658499.761141:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076517504 00000100:00100000:1.0:1788658499.761224:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:1.0:1788658499.761235:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076517504:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658499.761320:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2354:x1875544076517504:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 87us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658499.761329:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:0.0:1788658499.762421:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700539180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1875544103786496:192.168.202.3@tcp:105: 00010000:00010000:0.0:1788658499.762446:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658499.762540:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076517248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11305us (13183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.762549:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00080000:3.0:1788658499.764151:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658499.764192:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658499.764568:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076517760 00000100:00100000:2.0:1788658499.764577:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076517760 00000100:00100000:2.0:1788658499.764636:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:2.0:1788658499.764646:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:11374:x1875544076517760:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:2.0:1788658499.765021:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11374:x1875544076517760:12345-192.168.202.3@tcp:35:bash.0 Request processed in 375us (830us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788658499.765029:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:2.0:1788658499.851635:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658499.852106:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076518016 00000100:00100000:1.0:1788658499.852117:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076518016 00000100:00100000:1.0:1788658499.852183:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 144 00000100:00100000:1.0:1788658499.852193:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11384:x1875544076518016:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658499.852216:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658499.852236:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af7e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658499.852335:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788658499.852475:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb493 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af7e expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.852488:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:1.0:1788658499.852491:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658499.852496:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af7e expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.852660:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678000, rc 0) 00000100:00100000:1.0:1788658499.852819:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:11384:x1875544076518016:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 627us (1193us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1788658499.852826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 144 00000100:00100000:1.0:1788658499.857772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658499.858049:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076518272 00000100:00100000:2.0:1788658499.858069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076518272 00000100:00100000:2.0:1788658499.858130:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:2.0:1788658499.858140:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:11384:x1875544076518272:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1788658499.858406:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:11384:x1875544076518272:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 267us (644us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788658499.858413:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:2.0:1788658499.925345:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.925787:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076518400 00000100:00100000:0.0:1788658499.925799:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076518400 00000100:00100000:0.0:1788658499.925972:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 145 00000100:00100000:0.0:1788658499.925984:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:11390:x1875544076518400:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658499.926012:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658499.926036:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb4a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af85 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.926117:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb4a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.926131:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.926144:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658499.926178:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788658499.926181:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658499.926200:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.926242:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb4a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af85 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.926261:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af85 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.926429:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658499.926432:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658499.926436:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78a00, rc 0) 00000100:00100000:0.0:1788658499.926549:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:11390:x1875544076518400:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 566us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.926556:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 145 00000100:00100000:1.0:1788658499.934489:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658499.934593:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076518656 00000100:00100000:2.0:1788658499.934604:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076518656 00000100:00100000:2.0:1788658499.934684:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 146 00000100:00100000:2.0:1788658499.934695:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:11390:x1875544076518656:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658499.934717:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658499.934739:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb4af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af8c expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.934952:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb4b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.934966:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.934977:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658499.934988:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788658499.935123:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb4af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af8c expref: 24 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.935142:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af8c expref: 23 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.935150:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:2.0:1788658499.935153:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658499.935155:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a000, rc 0) 00000100:00100000:2.0:1788658499.935226:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:11390:x1875544076518656:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 533us (747us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788658499.935248:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 146 00000100:00100000:1.0:1788658499.937818:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658499.937873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.937996:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076518784 00000100:00100000:0.0:1788658499.938007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076518784 00000100:00100000:0.0:1788658499.938076:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1788658499.938087:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:2352:x1875544076518784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658499.938102:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658499.938126:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb4b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af8c expref: 23 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.938145:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:0.0:1788658499.938155:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658499.938206:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:2352:x1875544076518784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 121us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.938213:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1788658499.938274:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076519040 00000100:00100000:3.0:1788658499.938279:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076519040 00000100:00100000:3.0:1788658499.938316:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 147 00000100:00100000:3.0:1788658499.938323:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:11390:x1875544076519040:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658499.938343:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658499.938367:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb4c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af93 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.938451:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb4cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.938464:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.938491:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658499.938502:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788658499.938612:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb4c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af93 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.938627:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af93 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.938635:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:3.0:1788658499.938637:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788658499.938640:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:3.0:1788658499.938703:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11390:x1875544076519040:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 343us (791us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788658499.938710:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 147 00000100:00100000:0.0:1788658499.946720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658499.946844:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076519168 00000100:00100000:3.0:1788658499.946853:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076519168 00000100:00100000:3.0:1788658499.946891:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:3.0:1788658499.946898:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076519168:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1788658499.946934:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.946951:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.946956:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788658499.946965:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658499.946968:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.946996:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.947006:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 6 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658499.947016:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875544103786624:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658499.947162:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658499.953265:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875544103786624:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658499.953302:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658499.955790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658499.955985:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076519296 00000100:00100000:1.0:1788658499.955995:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076519296 00002000:00100000:1.0:1788658499.956059:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e5700fa1c00 x1875544076519296/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:90/0 lens 504/0 e 0 to 0 dl 1788658510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658499.956070:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700fa1c00 with x1875544076519296 ext(0->12) 00010000:00010000:1.0:1788658499.956079:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 7 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.956095:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 7 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658499.956103:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5700fa1c00 00000100:00100000:1.0:1788658499.956137:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:1.0:1788658499.956147:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076519296:12345-192.168.202.3@tcp:4:lfs.0 00000100:00100000:1.0:1788658499.956732:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2351:x1875544076519296:12345-192.168.202.3@tcp:4:lfs.0 Request processed in 584us (948us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788658499.956749:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00002000:00100000:1.0:1788658499.956755:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e5700fa1c00 x1875544076519296/t4294967305(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:90/0 lens 504/448 e 0 to 0 dl 1788658510 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658499.956762:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700fa1c00 with x1875544076519296 ext(0->12) 00010000:00010000:1.0:1788658499.956766:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 9 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.956775:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 9 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658499.956779:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5700fa1c00 00000100:00100000:2.0:1788658499.960886:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.961036:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076519424 00000100:00100000:0.0:1788658499.961057:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076519424 00010000:00010000:0.0:1788658499.961100:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 9 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658499.961151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:0.0:1788658499.961162:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2352:x1875544076519424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658499.961178:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788658499.961198:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788658499.961201:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788658499 00002000:00010000:0.0:1788658499.961204:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788658499 00002000:00010000:0.0:1788658499.961205:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788658499 00010000:00010000:0.0:1788658499.961211:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 9 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.961224:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 9 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.961247:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650eb48c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af77 expref: 9 pid: 6687 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.961265:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658499.961470:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658499.961477:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.961772:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.961976:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658499.962038:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076519424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 877us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.962055:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00010000:00010000:3.0:1788658499.964581:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964599:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964640:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964649:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964774:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964781:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658499.964786:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964795:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964813:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.964888:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650eb4d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658499.965040:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076519168:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 18137us (18372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658499.965059:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:2.0:1788658499.969793:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658499.969938:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076519680 00000100:00100000:1.0:1788658499.969946:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076519680 00000100:00100000:1.0:1788658499.970026:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:1.0:1788658499.970037:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11390:x1875544076519680:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:1.0:1788658499.970105:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af93 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658499.970801:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788658499.970857:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788658499.971570:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1788658499.971634:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.971652:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 28 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.971803:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.971936:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 28 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.971951:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 28 pid: 11367 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658499.971965:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570053aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875544103786752:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658499.972085:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d80180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658499.975249:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570053aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875544103786752:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658499.975278:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658499.976141:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.976473:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076519808 00000100:00100000:0.0:1788658499.976486:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076519808 00010000:00010000:0.0:1788658499.976541:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 29 pid: 11367 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658499.976582:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:0.0:1788658499.976591:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56cad4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:2352:x1875544076519808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658499.976609:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658499.976615:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 29 pid: 11367 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.976628:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 29 pid: 11367 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.976649:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af69 expref: 29 pid: 11367 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.976703:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:0.0:1788658499.976723:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.976732:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.976739:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.976765:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658499.976809:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56cad4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:2352:x1875544076519808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 218us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.976828:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00010000:00010000:3.0:1788658499.977001:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.977021:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658499.977161:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1788658499.977367:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788658499.977474:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570079df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875544103786880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788658499.977522:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658499.977569:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9624600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658499.978522:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103786880 00000100:00100000:0.0:1788658499.978532:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103786880 00000100:00100000:0.0:1788658499.978587:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658499.978597:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875544103786880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788658499.978718:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875544103786880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.978725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658499.978967:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570079df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875544103786880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788658499.979469:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788658499.979558:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875544103787008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788658499.979598:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658499.979628:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658499.979963:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103787008 00000100:00100000:1.0:1788658499.979969:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103787008 00000100:00100000:1.0:1788658499.980002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658499.980011:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875544103787008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788658499.980178:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875544103787008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (579us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788658499.980185:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658499.980222:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875544103787008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788658499.980279:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788658499.980316:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.980327:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.980334:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.980348:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658499.980353:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.980361:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.980376:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:1.0:1788658499.980379:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788658499.980384:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658499.980390:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788658499.980561:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788658499.980657:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788658499.980689:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391120022613ns, next at 392120020551ns, rc = 0 00000001:00080000:1.0:1788658499.980696:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788658499.980726:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579cd00) 00010000:00010000:1.0:1788658499.980729:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788658499.980736:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb4cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af93 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658499.981133:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:11390:x1875544076519680:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 11096us (11347us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788658499.981141:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000020:00080000:1.0:1788658499.981146:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788658499.982030:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658499.985278:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658499.986118:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076519936 00000100:00100000:0.0:1788658499.986130:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076519936 00000100:00100000:0.0:1788658499.986228:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 148 00000100:00100000:0.0:1788658499.986240:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:11390:x1875544076519936:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658499.986263:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658499.986296:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb4e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8af9a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.986371:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af9a expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.986402:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af9a expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658499.986424:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658499.986427:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658499.986430:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658499.986495:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:11390:x1875544076519936:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 257us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658499.986502:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 148 00000100:00100000:2.0:1788658499.989737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658499.989837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076520192 00000100:00100000:3.0:1788658499.989848:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076520192 00000100:00100000:3.0:1788658499.989902:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1788658499.989911:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:11390:x1875544076520192:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1788658499.990148:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:11390:x1875544076520192:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 238us (420us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788658499.990156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:0.0:1788658499.997056:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103787520:0@lo:400:kworker.0 00000100:00100000:0.0:1788658499.997132:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658499.997170:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658499.997176:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103787392:0@lo:400:kworker.0 00000100:00100000:0.0:1788658499.997199:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658499.997502:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103787264:0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.997547:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658499.997578:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788658499.997583:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103787136:0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.997610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658499.997634:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103787648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.997655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658499.997710:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103787392 00000100:00100000:3.0:1788658499.997718:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103787392 00000100:00100000:3.0:1788658499.997771:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103787264 00000100:00100000:3.0:1788658499.997789:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103787264 00000100:00100000:3.0:1788658499.997808:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103787648 00000100:00100000:3.0:1788658499.997822:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103787648 00000100:00100000:3.0:1788658499.997841:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788658499.997850:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103787392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.997905:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103787392:12345-0@lo:400:kworker.0 Request processed in 56us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658499.997912:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788658499.997929:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788658499.997935:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103787264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.997966:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103787264:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658499.997972:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788658499.997983:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788658499.997989:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103787648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.998015:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103787648:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658499.998021:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1788658499.998036:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658499.998096:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103787392:0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.998124:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103787648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658499.998132:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103787264:0@lo:400:kworker.0 00000100:00100000:1.0:1788658499.998528:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103787136 00000100:00100000:1.0:1788658499.998534:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103787136 00000100:00100000:1.0:1788658499.998577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788658499.998586:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103787136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658499.998632:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c562b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103787136:12345-0@lo:400:kworker.0 Request processed in 48us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658499.998638:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788658499.998699:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103787136:0@lo:400:kworker.0 00000100:00100000:1.0:1788658499.998722:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103787520 00000100:00100000:1.0:1788658499.998725:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103787520 00000100:00100000:1.0:1788658499.998753:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788658499.998759:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103787520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658499.998796:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103787520:12345-0@lo:400:kworker.0 Request processed in 37us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658499.998801:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788658499.998843:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103787520:0@lo:400:kworker.0 00000100:00100000:3.0:1788658500.070849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658500.070983:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076520448 00000100:00100000:0.0:1788658500.070996:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076520448 00000100:00100000:0.0:1788658500.071099:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 149 00000100:00100000:0.0:1788658500.071112:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:11400:x1875544076520448:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658500.071138:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658500.071159:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb4ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afa1 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658500.071249:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788658500.071374:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb4ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa1 expref: 35 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.071401:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:0.0:1788658500.071404:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658500.071414:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb4ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa1 expref: 35 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.071429:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78c00, rc 0) 00000100:00100000:0.0:1788658500.071491:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11400:x1875544076520448:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 381us (651us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1788658500.071498:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 149 00000100:00100000:2.0:1788658500.075645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658500.075833:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076520576 00000100:00100000:1.0:1788658500.075842:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076520576 00000100:00100000:1.0:1788658500.075890:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 150 00000100:00100000:1.0:1788658500.075899:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11400:x1875544076520576:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:1.0:1788658500.075965:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.075981:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.075993:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076018:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076026:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076043:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076124:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076139:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658500.076175:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076185:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076192:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076199:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076205:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658500.076209:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076222:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076233:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:1.0:1788658500.076236:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658500.076241:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076248:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb4fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076260:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076266:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076272:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076277:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658500.076280:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076286:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076292:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56c3c59000) 00010000:00010000:1.0:1788658500.076295:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658500.076298:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076313:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076328:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076334:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076354:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076359:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658500.076362:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076368:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076376:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:1.0:1788658500.076378:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658500.076381:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.076387:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb50a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658500.076459:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11400:x1875544076520576:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 559us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658500.076466:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 150 00000100:00100000:2.0:1788658500.079206:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658500.079282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076520832 00000100:00100000:3.0:1788658500.079291:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076520832 00000100:00100000:3.0:1788658500.079407:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:3.0:1788658500.079418:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11400:x1875544076520832:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1788658500.079644:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:11400:x1875544076520832:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 228us (446us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788658500.079652:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1788658500.120149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658500.120249:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076521088 00000100:00100000:0.0:1788658500.120259:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076521088 00000100:00100000:0.0:1788658500.120324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 151 00000100:00100000:0.0:1788658500.120344:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:11403:x1875544076521088:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658500.120368:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658500.120385:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afa8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120457:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120472:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120483:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120498:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120533:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120540:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120644:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120653:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120659:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658500.120698:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788658500.120775:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120780:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120784:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120788:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658500.120791:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.120796:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121221:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658500.121224:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658500.121229:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121235:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb518 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121252:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121258:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121263:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121269:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658500.121272:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121279:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121287:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56c3c69f00) 00010000:00010000:0.0:1788658500.121289:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658500.121292:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121297:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb51f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121412:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121428:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.121435:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658500.121438:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658500.121440:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79800, rc 0) 00000100:00100000:0.0:1788658500.121616:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:11403:x1875544076521088:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1282us (1476us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788658500.121624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 151 00000100:00100000:0.0:1788658500.125363:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658500.125455:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076521216 00000100:00100000:3.0:1788658500.125467:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076521216 00000100:00100000:3.0:1788658500.125647:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 152 00000100:00100000:3.0:1788658500.125659:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:11403:x1875544076521216:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:3.0:1788658500.125758:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.125775:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.125788:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.126008:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.126016:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.126031:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.126037:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658500.126041:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.126066:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.126078:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658500.126081:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658500.126086:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.126092:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658500.126205:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:11403:x1875544076521216:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 548us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658500.126213:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 152 00000100:00100000:2.0:1788658500.128572:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658500.128839:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076521472 00000100:00100000:1.0:1788658500.128848:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076521472 00000100:00100000:1.0:1788658500.128936:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:1.0:1788658500.128948:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:11403:x1875544076521472:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658500.129202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:11403:x1875544076521472:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 255us (637us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788658500.129209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00010000:00010000:3.0:1788658500.317039:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658500.386958:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658500.389468:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076521728 00000100:00100000:3.0:1788658500.389486:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076521728 00000100:00100000:3.0:1788658500.389575:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 153 00000100:00100000:3.0:1788658500.389586:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:11434:x1875544076521728:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1788658500.389613:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658500.389635:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb53b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afaf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.389792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.389809:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.389840:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658500.389855:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788658500.390005:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb53b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afaf expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.390028:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afaf expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.390037:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658500.390040:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658500.390043:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef600, rc 0) 00000100:00100000:3.0:1788658500.390117:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:11434:x1875544076521728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 533us (3169us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788658500.390125:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 153 00000100:00100000:2.0:1788658500.402762:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658500.403168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658500.403707:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076522112 00000100:00100000:3.0:1788658500.403718:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076522112 00000100:00100000:3.0:1788658500.403792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:3.0:1788658500.403803:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:11434:x1875544076522112:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1788658500.404074:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+41:11434:x1875544076522112:12345-192.168.202.3@tcp:35:cat.0 Request processed in 272us (904us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788658500.404081:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:0.0:1788658500.409782:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076521856 00000100:00100000:0.0:1788658500.409800:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076521856 00000100:00100000:0.0:1788658500.410036:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1788658500.410048:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+41:2353:x1875544076521856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658500.410064:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658500.410089:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afaf expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.410110:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658500.410116:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658500.410182:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:2353:x1875544076521856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 137us (7431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658500.410190:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1788658500.509969:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658500.510009:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c2dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103787776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658500.510081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658500.513476:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103787776 00000100:00100000:2.0:1788658500.513491:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103787776 00000100:00100000:2.0:1788658500.513577:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788658500.513589:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875544103787776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658500.513617:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658500.513735:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875544103787776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658500.513742:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788658500.513956:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c2dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103787776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658500.525611:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658500.525716:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076522368 00000100:00100000:0.0:1788658500.525727:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076522368 00000100:00100000:0.0:1788658500.525801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 154 00000100:00100000:0.0:1788658500.525811:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:11440:x1875544076522368:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:0.0:1788658500.525834:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658500.525837:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788658500.525859:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb4a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af85 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.525877:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658500.525882:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658500.525893:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb550 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afb6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.525988:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.526003:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.526012:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.526042:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.526066:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 40 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658500.526080:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103787904:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658500.526163:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658500.531874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658500.531988:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103787904:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658500.532016:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658500.532083:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076522496 00000100:00100000:3.0:1788658500.532091:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076522496 00010000:00010000:3.0:1788658500.532127:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 41 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658500.532184:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:3.0:1788658500.532193:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+41:2352:x1875544076522496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658500.532209:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658500.532216:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 41 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.532228:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 41 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.532250:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eb526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afa8 expref: 41 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.532266:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658500.532297:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.532307:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.532315:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.532343:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658500.532399:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:2352:x1875544076522496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 206us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658500.532406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00010000:00010000:0.0:1788658500.532748:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.532757:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658500.532776:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788658500.532921:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb550 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.532937:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.532945:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658500.532948:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658500.532950:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79e00, rc 0) 00000100:00100000:0.0:1788658500.532989:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:11440:x1875544076522368:12345-192.168.202.3@tcp:101:dd.0 Request processed in 7168us (7376us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788658500.533008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 154 00000100:00100000:2.0:1788658500.539290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658500.539409:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076522752 00000100:00100000:3.0:1788658500.539431:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076522752 00000100:00100000:3.0:1788658500.539483:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 155 00000100:00100000:3.0:1788658500.539494:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:11440:x1875544076522752:12345-192.168.202.3@tcp:36:dd.0 00010000:00010000:3.0:1788658500.539803:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.539822:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.539835:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658500.539886:0:11367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1788658500.539909:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8963d57 reply state 000000005d0af79d transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658500.539918:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658500.540020:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:11440:x1875544076522752:12345-192.168.202.3@tcp:36:dd.0 Request processed in 528us (752us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788658500.540028:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 155 00000020:00080000:3.0:1788658500.540033:0:11367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788658500.545916:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.545935:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.545943:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.545948:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658500.545953:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.545960:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.545987:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:1.0:1788658500.545990:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658500.545997:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658500.546002:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb565 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658500.809125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658500.809195:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076522880 00000100:00100000:3.0:1788658500.809204:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076522880 00000100:00100000:3.0:1788658500.809322:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 156 00000100:00100000:3.0:1788658500.809334:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+42:11455:x1875544076522880:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:3.0:1788658500.809366:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658500.809384:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb56c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afbd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809439:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809462:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809470:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809481:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809485:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809489:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809570:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809581:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809589:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809619:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.809629:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 43 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658500.809647:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103788032:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658500.809760:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658500.818271:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103788032:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658500.818311:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658500.818477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658500.819062:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076523136 00000100:00100000:3.0:1788658500.819071:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076523136 00000100:00100000:3.0:1788658500.819139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:3.0:1788658500.819150:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+44:5589:x1875544076523136:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788658500.819872:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:5589:x1875544076523136:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 720us (1392us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788658500.819881:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:2.0:1788658500.827636:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658500.827745:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076523264 00000100:00100000:0.0:1788658500.827756:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076523264 00010000:00010000:0.0:1788658500.827804:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 45 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658500.827892:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:0.0:1788658500.827902:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:2352:x1875544076523264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658500.827917:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658500.827924:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 45 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.827937:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 45 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.827967:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb557 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afb6 expref: 45 pid: 5837 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.827983:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658500.827988:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.827997:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.828005:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.828047:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658500.828092:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+44:2352:x1875544076523264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 192us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658500.828099:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00010000:00010000:3.0:1788658500.828153:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828161:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658500.828204:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788658500.828208:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658500.828230:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828242:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828271:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828278:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828285:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828290:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658500.828294:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828301:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828310:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658500.828312:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658500.828316:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828321:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828331:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828338:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828344:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828359:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658500.828362:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828369:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828376:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810500) 00010000:00010000:3.0:1788658500.828378:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658500.828381:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828386:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb57a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828419:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb56c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afbd expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828431:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afbd expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.828438:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658500.828440:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658500.828442:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eec00, rc 0) 00000100:00100000:3.0:1788658500.828465:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:11455:x1875544076522880:12345-192.168.202.3@tcp:101:stat.0 Request processed in 19134us (19348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658500.828471:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 156 00000100:00100000:2.0:1788658500.898223:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658500.898562:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076523520 00000100:00100000:0.0:1788658500.898573:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076523520 00000100:00100000:0.0:1788658500.898645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 157 00000100:00100000:0.0:1788658500.898655:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:11461:x1875544076523520:12345-192.168.202.3@tcp:36:truncate.0 00010000:00010000:0.0:1788658500.898747:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658500.898776:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afbd expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.898796:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658500.898802:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658500.899019:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.899033:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658500.899043:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658500.899094:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1788658500.899118:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fa0815f reply state 00000000fa2b0d66 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658500.899126:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658500.899241:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:11461:x1875544076523520:12345-192.168.202.3@tcp:36:truncate.0 Request processed in 587us (1028us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1788658500.899249:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 157 00000020:00080000:0.0:1788658500.899254:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788658500.906737:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.906767:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.906775:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.906781:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658500.906786:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.906794:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.906810:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658500.906814:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658500.906819:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658500.906825:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658501.067395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.067496:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076523648 00000100:00100000:0.0:1788658501.067507:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076523648 00000100:00100000:0.0:1788658501.067580:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 158 00000100:00100000:0.0:1788658501.067590:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+44:11475:x1875544076523648:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:0.0:1788658501.067611:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658501.067630:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb58f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afc4 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.067726:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.067742:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.067753:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788658501.067908:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788658501.067989:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.067999:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068006:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068092:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068114:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068122:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658501.068155:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788658501.068159:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658501.068182:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068193:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068200:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068206:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068212:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068217:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.068221:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068229:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068240:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658501.068249:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.068254:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068261:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb596 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068275:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068281:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068287:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068292:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.068295:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068301:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068308:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56c3c69f00) 00010000:00010000:0.0:1788658501.068311:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.068314:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068319:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb59d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068350:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb58f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 46 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068375:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 45 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.068383:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658501.068385:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658501.068387:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78200, rc 0) 00000100:00100000:0.0:1788658501.068451:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:11475:x1875544076523648:12345-192.168.202.3@tcp:101:stat.0 Request processed in 863us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.068459:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 158 00000100:00100000:2.0:1788658501.163576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658501.164959:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076523904 00000100:00100000:3.0:1788658501.164972:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076523904 00000100:00100000:3.0:1788658501.165184:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 159 00000100:00100000:3.0:1788658501.165195:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+45:11485:x1875544076523904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658501.165225:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658501.165248:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afcb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658501.165492:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788658501.165610:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afcb expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.165626:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:3.0:1788658501.165629:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658501.165635:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afcb expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.165650:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efe00, rc 0) 00000100:00100000:3.0:1788658501.165795:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+46:11485:x1875544076523904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 602us (2229us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1788658501.165811:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 159 00000100:00100000:2.0:1788658501.171119:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658501.171196:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076524160 00000100:00100000:1.0:1788658501.171205:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076524160 00000100:00100000:1.0:1788658501.171340:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:1.0:1788658501.171349:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+46:11485:x1875544076524160:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658501.171578:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:11485:x1875544076524160:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 229us (465us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788658501.171584:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:2.0:1788658501.235015:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658501.235109:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076524416 00000100:00100000:3.0:1788658501.235119:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076524416 00000100:00100000:3.0:1788658501.235179:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 160 00000100:00100000:3.0:1788658501.235190:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:11491:x1875544076524416:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658501.235213:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658501.235244:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afd2 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.235343:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.235359:0:11367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 48 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.235385:0:11367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.235416:0:11367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 48 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.235430:0:11367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 48 pid: 6710 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658501.235444:0:11367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103788160:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658501.235736:0:11367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658501.241195:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.241372:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076524544 00000100:00100000:0.0:1788658501.241382:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076524544 00010000:00010000:0.0:1788658501.241425:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 49 pid: 6710 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658501.241474:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 67 00000100:00100000:0.0:1788658501.241484:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+49:2352:x1875544076524544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658501.241499:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658501.241623:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 49 pid: 6710 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.241639:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 49 pid: 6710 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.241661:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658501.241694:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.241721:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.241729:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.241750:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658501.241805:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+49:2352:x1875544076524544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 322us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.241812:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 67 00010000:00010000:3.0:1788658501.242947:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb5a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afc4 expref: 48 pid: 6710 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658501.242969:0:11367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11367:1875544103788160:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658501.242992:0:11367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.243000:0:11367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.243006:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658501.243026:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788658501.243173:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 49 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.243307:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 48 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.243319:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658501.243322:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658501.243325:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658501.243426:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:11491:x1875544076524416:12345-192.168.202.3@tcp:101:bash.0 Request processed in 8236us (8419us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788658501.243433:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 160 00000100:00100000:2.0:1788658501.246183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.246356:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076524800 00000100:00100000:0.0:1788658501.246366:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076524800 00000100:00100000:0.0:1788658501.246463:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 161 00000100:00100000:0.0:1788658501.246474:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:11491:x1875544076524800:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:0.0:1788658501.246883:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.246912:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.246923:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658501.246975:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1788658501.247001:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e88f34e4 reply state 000000001c164d3a transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658501.247009:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658501.247091:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:11491:x1875544076524800:12345-192.168.202.3@tcp:36:bash.0 Request processed in 618us (914us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788658501.247114:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 161 00000020:00080000:0.0:1788658501.247119:0:6710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788658501.248422:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.248436:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.248443:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.248449:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658501.248454:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.248462:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.248477:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:1.0:1788658501.248480:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658501.248486:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.248492:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb5ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658501.253075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658501.253217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076524928 00000100:00100000:3.0:1788658501.253228:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076524928 00000100:00100000:3.0:1788658501.253288:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:3.0:1788658501.253298:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:11491:x1875544076524928:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658501.253322:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658501.253344:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afd9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.253430:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.253446:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 51 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.253456:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.253490:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 51 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.253806:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 51 pid: 11367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658501.253821:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103788288:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658501.253915:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658501.256779:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.256912:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875544103788288:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658501.256941:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658501.257122:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076525056 00000100:00100000:1.0:1788658501.257129:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076525056 00010000:00010000:1.0:1788658501.257171:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 52 pid: 11367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658501.257219:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:1.0:1788658501.257229:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:2351:x1875544076525056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658501.257244:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658501.257251:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 52 pid: 11367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.257263:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 52 pid: 11367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.257283:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb5c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd2 expref: 52 pid: 11367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.257298:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:1.0:1788658501.257303:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.257313:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.257320:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.257351:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658501.257422:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:2351:x1875544076525056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 193us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.257429:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00010000:00010000:3.0:1788658501.258229:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.258240:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658501.258287:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788658501.258292:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658501.258314:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.258351:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd9 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.258367:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd9 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.258375:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658501.258379:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658501.258382:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee800, rc 0) 00000100:00100000:3.0:1788658501.258437:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:11491:x1875544076524928:12345-192.168.202.3@tcp:101:bash.0 Request processed in 5140us (5371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658501.258453:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:3.0:1788658501.261495:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.261611:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076525312 00000100:00100000:0.0:1788658501.261621:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076525312 00000100:00100000:0.0:1788658501.261719:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:0.0:1788658501.261730:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:11491:x1875544076525312:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:0.0:1788658501.261960:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:11491:x1875544076525312:12345-192.168.202.3@tcp:35:bash.0 Request processed in 231us (474us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788658501.261967:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00010000:00010000:2.0:1788658501.341360:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658501.363000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658501.363087:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076525568 00000100:00100000:3.0:1788658501.363098:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076525568 00000100:00100000:3.0:1788658501.363156:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:3.0:1788658501.363166:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:11501:x1875544076525568:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658501.363194:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658501.363214:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afe0 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658501.363298:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788658501.363437:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afe0 expref: 53 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.363452:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:3.0:1788658501.363456:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658501.363462:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb5e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afe0 expref: 53 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.363476:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efe00, rc 0) 00000100:00100000:2.0:1788658501.364306:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11501:x1875544076525568:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1137us (1312us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1788658501.364316:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:2.0:1788658501.369319:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.369414:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076525696 00000100:00100000:0.0:1788658501.369426:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076525696 00000100:00100000:0.0:1788658501.369489:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00100000:0.0:1788658501.369501:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11501:x1875544076525696:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:0.0:1788658501.369578:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369591:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369600:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369611:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369627:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369631:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369721:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369727:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369730:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658501.369954:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369968:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369975:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369981:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369988:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.369992:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.369999:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370020:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658501.370023:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.370029:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370036:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb5f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370049:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370054:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370059:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370063:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.370066:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370072:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370079:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56c3c69f00) 00010000:00010000:0.0:1788658501.370081:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.370084:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370089:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb5f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370118:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370123:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370129:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370135:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.370138:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370144:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370152:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658501.370154:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.370157:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.370163:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb5ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658501.370270:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11501:x1875544076525696:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 770us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.370276:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00100000:3.0:1788658501.374643:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.374738:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076525952 00000100:00100000:0.0:1788658501.374759:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076525952 00000100:00100000:0.0:1788658501.374836:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:0.0:1788658501.374860:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11501:x1875544076525952:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658501.375102:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:11501:x1875544076525952:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 244us (469us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788658501.375110:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:2.0:1788658501.417037:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658501.417136:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076526208 00000100:00100000:3.0:1788658501.417146:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076526208 00000100:00100000:3.0:1788658501.417401:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:3.0:1788658501.417412:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+53:11504:x1875544076526208:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658501.417438:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658501.417472:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.417549:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.417563:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.417575:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.417588:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.417595:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.417602:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418657:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb61b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418697:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418707:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658501.418716:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788658501.418807:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418827:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418834:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418839:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efe00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658501.418843:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418850:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418861:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658501.418864:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658501.418870:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418887:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb60d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418903:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418908:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418913:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418918:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658501.418926:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418932:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418940:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810500) 00010000:00010000:3.0:1788658501.418942:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658501.418946:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418951:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb614 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.418999:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afe7 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.419011:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb61b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afe7 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658501.419018:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:3.0:1788658501.419020:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658501.419022:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee400, rc 0) 00000100:00100000:3.0:1788658501.421042:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:11504:x1875544076526208:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3621us (4005us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788658501.421057:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:2.0:1788658501.438860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658501.439002:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658501.439170:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076526464 00000100:00100000:1.0:1788658501.439180:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076526464 00000100:00100000:1.0:1788658501.439261:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658501.439272:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:2351:x1875544076526464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658501.439290:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658501.439315:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eb61b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afe7 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.439338:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:1.0:1788658501.439344:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658501.439402:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:2351:x1875544076526464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 133us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.439409:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:0.0:1788658501.440088:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076526336 00000100:00100000:0.0:1788658501.440095:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076526336 00000100:00100000:0.0:1788658501.440369:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:0.0:1788658501.440379:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:11504:x1875544076526336:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1788658501.440436:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440452:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440464:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440490:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440496:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440503:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440509:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.440513:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440535:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440544:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658501.440547:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658501.440551:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.440557:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658501.440618:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:11504:x1875544076526336:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 241us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.440625:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:2.0:1788658501.443501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.443587:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076526720 00000100:00100000:0.0:1788658501.443597:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076526720 00000100:00100000:2.0:1788658501.443846:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:2.0:1788658501.443858:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:11504:x1875544076526720:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1788658501.444453:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:11504:x1875544076526720:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 595us (964us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788658501.444474:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:3.0:1788658501.643262:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.643569:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076526976 00000100:00100000:0.0:1788658501.643579:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076526976 00000100:00100000:0.0:1788658501.643647:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:0.0:1788658501.643658:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:11522:x1875544076526976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1788658501.643707:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658501.643726:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8afee expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.643980:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb637 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.643997:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.644028:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658501.644040:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788658501.644243:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afee expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.644263:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afee expref: 57 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.644271:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658501.644274:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788658501.644278:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78c00, rc 0) 00000100:00100000:0.0:1788658501.644380:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11522:x1875544076526976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 715us (1119us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788658501.644387:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:1.0:1788658501.670788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.670970:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076527104 00000100:00100000:0.0:1788658501.670982:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076527104 00000100:00100000:0.0:1788658501.671044:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:0.0:1788658501.671055:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11523:x1875544076527104:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658501.671081:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658501.671101:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb645 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8aff5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.671208:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb64c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.671234:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.671255:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658501.671293:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788658501.671297:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658501.671317:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.671342:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aff5 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.671359:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb64c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aff5 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.671544:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658501.671548:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658501.671552:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78400, rc 0) 00000100:00100000:0.0:1788658501.671615:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11523:x1875544076527104:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 562us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.671621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:2.0:1788658501.680263:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.680362:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076527488 00000100:00100000:0.0:1788658501.680382:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076527488 00000100:00100000:0.0:1788658501.680445:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1788658501.680456:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11523:x1875544076527488:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658501.680784:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11523:x1875544076527488:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 330us (540us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788658501.680951:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:3.0:1788658501.685609:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658501.686176:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076527616 00000100:00100000:1.0:1788658501.686188:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076527616 00000100:00100000:1.0:1788658501.686263:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658501.686275:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56cad4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11523:x1875544076527616:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:1.0:1788658501.686293:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788658501.686318:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eb5dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afd9 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.686342:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb637 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8afee expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.686373:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb4e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af9a expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658501.686383:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c69d00) 00010000:00010000:1.0:1788658501.686395:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658501.686455:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56cad4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:11523:x1875544076527616:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 183us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.686463:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658501.691136:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658501.691224:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076527744 00000100:00100000:2.0:1788658501.691234:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076527744 00000100:00100000:2.0:1788658501.691302:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 169 00000100:00100000:2.0:1788658501.691312:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:11523:x1875544076527744:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:2.0:1788658501.691422:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658501.691437:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658501.691450:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658501.691648:0:11367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788658501.691755:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:11523:x1875544076527744:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 444us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658501.691763:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 169 00000100:00100000:2.0:1788658501.720866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658501.720941:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076527872 00000100:00100000:0.0:1788658501.720952:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076527872 00000100:00100000:0.0:1788658501.721013:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 170 00000100:00100000:0.0:1788658501.721025:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:11525:x1875544076527872:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658501.721046:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658501.721067:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb65a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8affc expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721132:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721148:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721171:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721187:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721194:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721200:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721284:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721306:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721313:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658501.721349:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788658501.721353:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658501.721373:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721385:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721394:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721400:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721406:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721412:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.721417:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721425:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721437:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658501.721440:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.721453:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721459:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721474:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721480:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721485:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721489:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658501.721492:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721497:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721504:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56c3c69f00) 00010000:00010000:0.0:1788658501.721507:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.721509:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721514:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721545:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb65a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721568:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 57 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.721575:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:0.0:1788658501.721577:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658501.721579:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78e00, rc 0) 00000100:00100000:0.0:1788658501.721647:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11525:x1875544076527872:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 625us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.721655:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 170 00000001:00080000:2.0:1788658502.129077:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788658502.129093:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:1.0:1788658502.174301:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658502.174310:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658502.174368:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788658502.174374:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658502.174497:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570053ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103788416:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658502.174589:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658502.186655:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570053ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103788416:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788658502.204164:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658502.204249:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076528000 00000100:00100000:1.0:1788658502.204259:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076528000 00000100:00100000:1.0:1788658502.204322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 171 00000100:00100000:1.0:1788658502.204331:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11536:x1875544076528000:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658502.204363:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658502.204471:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11536:x1875544076528000:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 140us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658502.204478:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 171 00000100:00100000:3.0:1788658502.217088:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658502.217242:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076528128 00000100:00100000:0.0:1788658502.217253:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076528128 00000100:00100000:0.0:1788658502.217300:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:0.0:1788658502.217310:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11536:x1875544076528128:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788658502.217380:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217398:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217411:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217467:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217475:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217493:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217522:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217530:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217537:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658502.217573:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788658502.217577:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658502.217590:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217601:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217607:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217614:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217619:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658502.217624:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217631:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217649:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:0.0:1788658502.217651:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658502.217656:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217661:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb676 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217947:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217953:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217959:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.217965:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658502.218166:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218174:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218182:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9e56c3c69d00) 00010000:00010000:0.0:1788658502.218185:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658502.218189:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218195:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb67d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218225:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218230:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218235:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218239:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658502.218242:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218248:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218255:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:0.0:1788658502.218257:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658502.218259:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.218264:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658502.218475:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11536:x1875544076528128:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 1164us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658502.218483:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:2.0:1788658502.232262:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.232346:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076528384 00000100:00100000:3.0:1788658502.232356:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076528384 00000100:00100000:3.0:1788658502.232411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 173 00000100:00100000:3.0:1788658502.232420:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11536:x1875544076528384:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.232438:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658502.232456:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb68b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b003 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232545:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232559:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232570:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658502.232581:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788658502.232793:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232802:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232809:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232815:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.232819:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232834:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232847:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:3.0:1788658502.232850:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658502.232855:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232861:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232898:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb68b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b003 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232908:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:3.0:1788658502.232910:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658502.232913:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb68b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b003 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.232922:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658502.233057:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11536:x1875544076528384:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 637us (803us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1788658502.233065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 173 00000100:00100000:1.0:1788658502.248339:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.248867:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076528512 00000100:00100000:3.0:1788658502.248878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076528512 00000100:00100000:3.0:1788658502.248929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 174 00000100:00100000:3.0:1788658502.248939:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11536:x1875544076528512:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788658502.248996:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788658502.249119:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11536:x1875544076528512:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 180us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.249127:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 174 00000100:00100000:2.0:1788658502.254708:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.254996:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076528768 00000100:00100000:3.0:1788658502.255010:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076528768 00000100:00100000:3.0:1788658502.255071:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 175 00000100:00100000:3.0:1788658502.255081:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11536:x1875544076528768:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.255110:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658502.255114:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788658502.255139:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb64c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aff5 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.255157:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658502.255161:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658502.255173:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b00a expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658502.255566:0:11367:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788658502.256224:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb6a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.256239:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.256249:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.256320:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b00a expref: 60 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.256335:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b00a expref: 59 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.256342:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658502.256344:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658502.256346:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eec00, rc 0) 00000100:00100000:3.0:1788658502.256454:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11536:x1875544076528768:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1374us (1756us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788658502.256463:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 175 00000100:00100000:1.0:1788658502.265853:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.266059:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076529024 00000100:00100000:3.0:1788658502.266069:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076529024 00000100:00100000:3.0:1788658502.266190:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 176 00000100:00100000:3.0:1788658502.266201:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11536:x1875544076529024:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.266262:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658502.266288:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb6a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b00a expref: 59 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266306:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658502.266317:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658502.266340:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266355:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266371:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266387:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266394:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266400:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266461:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266467:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266472:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266477:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.266481:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266488:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266497:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658502.266499:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658502.266503:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266514:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb6b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266523:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266529:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266533:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266537:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.266539:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266544:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266550:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x718ef5e7 (ffff9e56d0810200) 00010000:00010000:3.0:1788658502.266552:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658502.266555:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.266560:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x718ef5e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.266638:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11536:x1875544076529024:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 437us (792us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658502.266645:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 176 00000100:00100000:2.0:1788658502.268795:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.268940:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076529152 00000100:00100000:3.0:1788658502.268950:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076529152 00000100:00100000:3.0:1788658502.269015:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 177 00000100:00100000:3.0:1788658502.269025:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11536:x1875544076529152:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.269045:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658502.269069:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b011 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.269248:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.269263:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.269273:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.269367:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 60 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.269384:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 59 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.269392:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.269395:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658502.269399:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef200, rc 0) 00000100:00100000:3.0:1788658502.269446:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11536:x1875544076529152:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 423us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.269453:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 177 00000100:00100000:2.0:1788658502.274526:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.274955:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076529408 00000100:00100000:3.0:1788658502.274975:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076529408 00000100:00100000:3.0:1788658502.275057:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 178 00000100:00100000:3.0:1788658502.275067:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11536:x1875544076529408:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.275152:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.275168:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.275179:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658502.276143:0:11367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788658502.276155:0:11367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393415489940ns, next at 394415487537ns, rc = 0 00000004:00010000:3.0:1788658502.276248:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008edd2658 reply state 00000000f04823c3 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.276258:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658502.276417:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11536:x1875544076529408:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1348us (1897us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788658502.276426:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 178 00010000:00010000:3.0:1788658502.278450:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.278465:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.278473:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.278496:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.278502:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.278510:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.278527:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.278530:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658502.278534:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.278540:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb6d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658502.279968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.280046:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076529536 00000100:00100000:3.0:1788658502.280057:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076529536 00000100:00100000:3.0:1788658502.280118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 179 00000100:00100000:3.0:1788658502.280129:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11536:x1875544076529536:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.280154:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658502.280175:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b018 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.280236:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.280250:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.280282:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.280286:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658502.280290:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef000, rc 0) 00000100:00100000:3.0:1788658502.280359:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11536:x1875544076529536:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 231us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.280366:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 179 00000100:00100000:0.0:1788658502.289752:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.289810:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076529664 00000100:00100000:3.0:1788658502.289821:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076529664 00000100:00100000:3.0:1788658502.289908:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:3.0:1788658502.289920:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076529664:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788658502.290468:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076529664:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 548us (724us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788658502.290477:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00080000:0.0:1788658502.290640:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658502.296658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658502.297328:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076529920 00000100:00100000:0.0:1788658502.297359:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076529920 00000100:00100000:0.0:1788658502.297431:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1788658502.297442:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11536:x1875544076529920:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788658502.298067:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11536:x1875544076529920:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 623us (1417us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788658502.298075:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:2.0:1788658502.302497:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.305273:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076530176 00000100:00100000:3.0:1788658502.305289:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076530176 00000100:00100000:2.0:1788658502.306364:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 180 00000100:00100000:2.0:1788658502.306377:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11536:x1875544076530176:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788658502.306503:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11536:x1875544076530176:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 127us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658502.306511:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 180 00000100:00100000:1.0:1788658502.324095:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.324179:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076530304 00000100:00100000:3.0:1788658502.324189:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076530304 00000100:00100000:3.0:1788658502.324246:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 181 00000100:00100000:3.0:1788658502.324255:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11536:x1875544076530304:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.324276:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658502.324295:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb6df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b01f expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.324367:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb6e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.324393:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.324405:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658502.324441:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658502.324459:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.324483:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb6df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b01f expref: 64 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.324500:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b01f expref: 63 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.324509:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.324511:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788658502.324515:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efe00, rc 0) 00000100:00100000:3.0:1788658502.324596:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+63:11536:x1875544076530304:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 342us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.324604:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 181 00000100:00100000:1.0:1788658502.334953:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.337608:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076530432 00000100:00100000:3.0:1788658502.337622:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076530432 00000100:00100000:0.0:1788658502.337809:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1788658502.337822:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076530432:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658502.337840:0:10289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658502.337859:0:10289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b026 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658502.337886:0:10289:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc345, blocks: 0x1 00010000:00010000:0.0:1788658502.337903:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788658502.337907:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658502.337916:0:10289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 8 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.337934:0:10289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 8 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.337947:0:10289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78200, rc 0) 00000100:00100000:0.0:1788658502.338015:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076530432:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 195us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658502.338022:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1788658502.352254:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.352346:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076530688 00000100:00100000:3.0:1788658502.352357:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076530688 00000100:00100000:3.0:1788658502.352418:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 182 00000100:00100000:3.0:1788658502.352430:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+63:11536:x1875544076530688:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788658502.352575:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+63:11536:x1875544076530688:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 146us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.352583:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 182 00000100:00100000:1.0:1788658502.358643:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.358808:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076530816 00000100:00100000:3.0:1788658502.358818:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076530816 00000100:00100000:3.0:1788658502.358876:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1788658502.358887:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:11536:x1875544076530816:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.358906:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658502.358925:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b02d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.358960:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 9 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.358969:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658502.358973:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658502.358979:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.359013:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 9 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.359026:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 9 pid: 10289 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.359039:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875544103788544:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658502.359233:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658502.370307:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875544103788544:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658502.370342:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658502.370364:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:0.0:1788658502.370428:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:11536:x1875544076530816:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 11543us (11793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658502.370438:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00010000:00010000:2.0:1788658502.370552:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658502.372546:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.372710:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076530944 00000100:00100000:3.0:1788658502.372720:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076530944 00010000:00010000:3.0:1788658502.372763:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 9 pid: 10289 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.372816:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1788658502.372826:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2351:x1875544076530944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658502.372842:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658502.372864:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 9 pid: 10289 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.372878:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 9 pid: 10289 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.372903:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb6ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b026 expref: 9 pid: 10289 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.372918:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658502.372922:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658502.372930:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.372941:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.372997:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.373011:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875544103788672:192.168.202.3@tcp:105: 00000100:00100000:3.0:1788658502.373094:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658502.376231:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875544103788672:192.168.202.3@tcp:105: 00010000:00010000:0.0:1788658502.376257:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658502.376307:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2351:x1875544076530944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3481us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658502.376317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:2.0:1788658502.380306:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658502.382224:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076531072 00000100:00100000:0.0:1788658502.382238:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076531072 00002000:00100000:0.0:1788658502.382298:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e57005ab480 x1875544076531072/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:93/0 lens 504/0 e 0 to 0 dl 1788658513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658502.382310:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e57005ab480 with x1875544076531072 ext(0->8) 00002000:00010000:0.0:1788658502.382316:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e57005ab480 00000100:00100000:0.0:1788658502.382345:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1788658502.382355:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076531072:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788658502.382851:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2352:x1875544076531072:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 495us (2555us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788658502.382869:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00002000:00100000:0.0:1788658502.382877:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e57005ab480 x1875544076531072/t4294967314(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:93/0 lens 504/448 e 0 to 0 dl 1788658513 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658502.382886:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e57005ab480 with x1875544076531072 ext(0->8) 00002000:00010000:0.0:1788658502.382890:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e57005ab480 00000100:00100000:2.0:1788658502.385721:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.385915:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076531200 00000100:00100000:3.0:1788658502.385926:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076531200 00000100:00100000:3.0:1788658502.385982:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 183 00000100:00100000:3.0:1788658502.385992:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+63:11536:x1875544076531200:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788658502.468953:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+63:11536:x1875544076531200:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 82950us (83229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.468968:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 183 00000001:00080000:3.0:1788658502.469008:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1788658502.469041:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788658502.469082:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56dea96300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788658502.469086:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff966100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56dea96f00 00000020:00080000:3.0:1788658502.469089:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff966d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e56faf9d400 00000004:00080000:3.0:1788658502.469110:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788658502.469252:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788658502.469422:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788658502.469487:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103788800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788658502.469543:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658502.469598:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658502.469605:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103788928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788658502.469641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658502.469700:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103788800 00000100:00100000:3.0:1788658502.469707:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103788800 00000100:00100000:3.0:1788658502.469752:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103788928 00000100:00100000:3.0:1788658502.469772:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103788928 00000100:00100000:3.0:1788658502.469798:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658502.469806:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103788800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788658502.469832:0:10289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788658502.469866:0:10289:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cc343, atime: 0x6a9cc343, ctime: 0x6a9cc343, blocks: 0xb 00010000:00010000:3.0:1788658502.469874:0:10289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.469891:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1788658502.469895:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658502.469902:0:10289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.469918:0:10289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.469929:0:10289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.469937:0:10289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.469955:0:10289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658502.470432:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103788800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 625us (889us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788658502.470441:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658502.470458:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658502.470465:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103788928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788658502.470568:0:10289:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788658502.470571:0:10289:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788658502 00002000:00010000:3.0:1788658502.470574:0:10289:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788658502.470576:0:10289:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788658501 -> 1788658502 00002000:00010000:3.0:1788658502.470578:0:10289:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788658502.470604:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103788928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (961us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788658502.470610:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788658502.470635:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658502.470639:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788658502.470655:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658502.470661:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.470692:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658502.470697:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.470708:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.470726:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.470740:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650eb6fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.470776:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658502.470778:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658502.470780:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788658502.470810:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e56faeb8380/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788658502.470816:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103788928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788658502.470828:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788658502.470834:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788658502.470855:0:3306:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e56faebb480 x1875544103788800/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788658518 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788658502.470865:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e56faebb480/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788658502.470868:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103788800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788658502.473868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658502.474033:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076531328 00000100:00100000:1.0:1788658502.474044:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076531328 00000100:00100000:1.0:1788658502.474106:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:1.0:1788658502.474115:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2352:x1875544076531328:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000040:00080000:3.0:1788658502.512915:0:12459:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658502.512926:0:12459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788658502.512992:0:12459:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788658502.512998:0:12459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658502.550188:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2352:x1875544076531328:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 76062us (76315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658502.550204:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00000001:00080000:2.0:1788658502.550946:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1788658502.550967:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788658502.556409:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.556493:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076531584 00000100:00100000:3.0:1788658502.556504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076531584 00000100:00100000:3.0:1788658502.556574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 184 00000100:00100000:3.0:1788658502.556583:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11536:x1875544076531584:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.556636:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658502.556695:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb6e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b01f expref: 18 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.556732:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.556737:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658502.556780:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.556795:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.556807:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658502.557084:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ea3d3b5 reply state 00000000b93d30b2 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.557094:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658502.557200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:11536:x1875544076531584:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 617us (804us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788658502.557208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 184 00010000:00010000:1.0:1788658502.559417:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.559434:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.559442:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.559448:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658502.559453:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.559460:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.559475:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:1.0:1788658502.559478:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658502.559497:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.559503:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eb702 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658502.570758:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658502.570840:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076531712 00000100:00100000:1.0:1788658502.570851:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076531712 00000100:00100000:1.0:1788658502.570905:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:1.0:1788658502.570917:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2354:x1875544076531712:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788658502.571167:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788658502.571172:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788658502 -> 1788658500 00002000:00010000:1.0:1788658502.571175:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788658499 00002000:00010000:1.0:1788658502.571177:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788658502 -> 1788658500 00002000:00010000:1.0:1788658502.571179:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788658502.571240:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2354:x1875544076531712:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 325us (503us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788658502.571247:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:3.0:1788658502.573878:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658502.574761:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076531968 00000100:00100000:1.0:1788658502.574773:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076531968 00000100:00100000:1.0:1788658502.574838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 185 00000100:00100000:1.0:1788658502.574850:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11536:x1875544076531968:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788658502.574920:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.574938:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.574962:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.574995:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.575009:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 18 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658502.575022:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570053a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103789056:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658502.575122:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5676480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658502.578852:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658502.579155:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570053a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103789056:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658502.579185:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.579471:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076532096 00000100:00100000:3.0:1788658502.579479:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076532096 00010000:00010000:3.0:1788658502.579516:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 19 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.579642:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:3.0:1788658502.579652:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:2351:x1875544076532096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658502.579693:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658502.579701:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 19 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.579723:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 19 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.579759:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb6ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b011 expref: 19 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.579773:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.579778:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.579788:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.579796:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.579822:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658502.579870:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:2351:x1875544076532096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 219us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.579877:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 70 00010000:00010000:1.0:1788658502.580541:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580551:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580581:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580588:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580595:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580601:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658502.580606:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580626:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580637:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:1.0:1788658502.580640:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788658502.580644:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.580651:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679200/0xf657f176650eb709 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658502.580724:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:11536:x1875544076531968:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 5875us (6855us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788658502.580733:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 185 00000100:00100000:3.0:1788658502.589960:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658502.590035:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076532224 00000100:00100000:2.0:1788658502.590046:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076532224 00000100:00100000:2.0:1788658502.590115:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:2.0:1788658502.590125:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2353:x1875544076532224:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788658502.590172:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.590195:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.590205:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658502.590220:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658502.590225:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.590267:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.590284:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 8 pid: 6687 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658502.590300:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103789184:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658502.590388:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c1254180 going to sleep for 11 seconds 00000100:00100000:0.0:1788658502.597211:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658502.597472:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076532352 00000100:00100000:1.0:1788658502.597482:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076532352 00010000:00010000:1.0:1788658502.597536:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 9 pid: 6687 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658502.597580:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:1.0:1788658502.597591:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2351:x1875544076532352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658502.597607:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658502.597631:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 9 pid: 6687 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.597645:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 9 pid: 6687 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.597709:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658502.597713:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658502.597720:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.597730:0:7635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.597761:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658502.597818:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2351:x1875544076532352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 229us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658502.597826:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 71 00010000:00010000:3.0:1788658502.598442:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017427a42/0xf657f176650eb6f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b02d expref: 8 pid: 6687 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.598457:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103789184:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658502.598477:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598501:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598507:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598541:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598550:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598559:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598565:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658502.598569:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598579:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598591:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.598607:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650eb710 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.598652:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076532224:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 8528us (8703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.598659:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:1.0:1788658502.609809:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.609887:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076532608 00000100:00100000:3.0:1788658502.609898:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076532608 00000100:00100000:3.0:1788658502.609967:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 186 00000100:00100000:3.0:1788658502.609977:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+17:11536:x1875544076532608:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788658502.610072:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.610089:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.610102:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.610293:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.610302:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.610311:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.610353:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.610367:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 18 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.610382:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103789312:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658502.610463:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d54b8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658502.613260:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103789312:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658502.613290:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658502.618216:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658502.618284:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076532736 00000100:00100000:3.0:1788658502.618293:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076532736 00010000:00010000:3.0:1788658502.618330:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 19 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.618373:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:3.0:1788658502.618382:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:2352:x1875544076532736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658502.618396:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658502.618402:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 19 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.618414:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 19 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.618436:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb6d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b018 expref: 19 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.618449:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.618461:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.618470:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.618477:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.618503:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658502.618551:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:2352:x1875544076532736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 170us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.618558:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 72 00010000:00010000:3.0:1788658502.618636:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.618645:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658502.618865:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788658502.619007:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788658502.619054:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788658502.619131:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103789440:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788658502.619178:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658502.619205:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d80180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658502.619225:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103789440 00000100:00100000:3.0:1788658502.619229:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103789440 00000100:00100000:3.0:1788658502.619258:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658502.619265:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6710:x1875544103789440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788658502.619331:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6710:x1875544103789440:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.619344:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658502.619383:0:6710:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788658502.619389:0:6710:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e56faeb8380, transno 4294967315 00000100:00100000:3.0:1788658502.619402:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103789440:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788658502.619865:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788658502.619919:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103789568:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788658502.619946:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658502.619964:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cb171e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658502.620138:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103789568 00000100:00100000:3.0:1788658502.620143:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103789568 00000100:00100000:3.0:1788658502.620169:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658502.620176:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6710:x1875544103789568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788658502.620309:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6710:x1875544103789568:12345-0@lo:1000:mdt00_003.0 Request processed in 133us (361us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788658502.620316:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658502.620348:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103789568:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788658502.620375:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620384:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620391:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620396:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.620400:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620415:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620427:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d0810300) 00010000:00010000:3.0:1788658502.620430:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658502.620435:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620441:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb71e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620469:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620475:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620482:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620487:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.620489:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620495:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620503:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:3.0:1788658502.620505:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658502.620508:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620523:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb653 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620544:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620558:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 21 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620567:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620589:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 21 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.620604:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 21 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.620615:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103789696:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658502.620685:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658502.624491:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658502.624879:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076532864 00000100:00100000:1.0:1788658502.624889:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076532864 00010000:00010000:1.0:1788658502.624931:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 22 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658502.624974:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:1.0:1788658502.624984:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:2351:x1875544076532864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658502.624997:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658502.625011:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 22 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.625024:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 22 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.625044:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:1.0:1788658502.625049:0:7635:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.625059:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.625067:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.625086:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658502.625132:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:2351:x1875544076532864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658502.625139:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00010000:00010000:3.0:1788658502.625363:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78e00/0xf657f176650eb66f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8affc expref: 21 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.625379:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103789696:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658502.625435:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625445:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625457:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625469:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625475:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625482:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625487:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efe00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.625491:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625498:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625506:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:3.0:1788658502.625509:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658502.625513:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625524:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb725 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625535:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625541:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625553:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625558:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658502.625561:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625568:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625576:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:3.0:1788658502.625579:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658502.625582:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658502.625588:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb717 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658502.625842:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:11536:x1875544076532608:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 15864us (16042us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1788658502.625851:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 186 00000020:00080000:3.0:1788658502.625855:0:6710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788658502.626161:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658502.626166:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658502.626654:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788658502.626693:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658502.632291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658502.632388:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076533120 00000100:00100000:2.0:1788658502.632400:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076533120 00000100:00100000:2.0:1788658502.632486:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:2.0:1788658502.632497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:11536:x1875544076533120:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788658502.633289:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788658502.633395:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1788658502.633440:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.633456:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.633468:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.633477:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.633489:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.633495:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658502.633686:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788658502.633797:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:11536:x1875544076533120:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 1298us (1515us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788658502.633805:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000020:00080000:2.0:1788658502.633811:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788658502.640753:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658502.640769:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.640780:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658502.640793:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.640805:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.640822:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:1.0:1788658502.640826:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788658502.640830:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.640837:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb72c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658502.640859:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658502.640861:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658502.640862:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658503.389689:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658504.246839:0:12510:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658504.246849:0:12510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658504.246910:0:12510:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788658504.246917:0:12510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658504.339643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.339988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076533376 00000100:00100000:3.0:1788658504.340000:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076533376 00000100:00100000:3.0:1788658504.340078:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 187 00000100:00100000:3.0:1788658504.340088:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:11554:x1875544076533376:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658504.340111:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658504.340130:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b034 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.340243:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb73a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.340256:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb73a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.340268:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb73a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658504.340279:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000100:00080000:0.0:1788658504.340341:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658504.340390:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b034 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.340406:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb73a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b034 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.340415:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658504.340418:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658504.340422:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007efe00, rc 0) 00000100:00100000:3.0:1788658504.340481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11554:x1875544076533376:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 394us (847us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788658504.340488:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 187 00000100:00100000:3.0:1788658504.344504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658504.344583:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076533504 00000100:00100000:1.0:1788658504.344592:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076533504 00000100:00100000:1.0:1788658504.344649:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:1.0:1788658504.344659:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11554:x1875544076533504:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:1.0:1788658504.344766:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.344783:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.344795:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.344809:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.344824:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.344830:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345141:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345149:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345156:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658504.345193:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345206:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345212:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345219:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345226:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658504.345230:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345238:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345256:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:1.0:1788658504.345259:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658504.345264:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345271:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345283:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345290:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345296:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345301:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658504.345304:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345311:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345319:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56c3c59f00) 00010000:00010000:1.0:1788658504.345321:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658504.345323:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345329:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb74f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345357:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345363:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345369:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345374:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658504.345377:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345383:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345390:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56c3c59300) 00010000:00010000:1.0:1788658504.345392:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658504.345394:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.345400:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eb756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658504.348798:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11554:x1875544076533504:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 4127us (4289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658504.348814:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:0.0:1788658504.399212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.399776:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076533760 00000100:00100000:3.0:1788658504.399786:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076533760 00000100:00100000:3.0:1788658504.399837:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 189 00000100:00100000:3.0:1788658504.399848:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11557:x1875544076533760:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658504.399879:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658504.399900:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb75d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b03b expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.399976:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.399992:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400005:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400020:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400028:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400036:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400290:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400319:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400328:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658504.400339:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788658504.400444:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400453:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400460:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400467:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.400471:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400479:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400493:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658504.400497:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.400502:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400509:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400521:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400527:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400533:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400705:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.400715:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400723:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400732:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810300) 00010000:00010000:3.0:1788658504.400734:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.400737:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400744:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb76b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400787:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb75d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 27 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400801:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 26 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.400809:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658504.400811:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658504.400813:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658504.400880:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11557:x1875544076533760:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1032us (1678us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788658504.400888:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 189 00000100:00100000:2.0:1788658504.416775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658504.416809:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076533888 00000100:00100000:2.0:1788658504.416818:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076533888 00000100:00100000:2.0:1788658504.416868:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:2.0:1788658504.416878:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11557:x1875544076533888:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1788658504.416944:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.416961:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.416973:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.416998:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.417018:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.417025:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.417031:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658504.417036:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.417043:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.417056:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:2.0:1788658504.417059:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658504.417063:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.417070:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658504.417132:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11557:x1875544076533888:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 256us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658504.417140:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:3.0:1788658504.420068:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.420100:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076534144 00000100:00100000:3.0:1788658504.420109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076534144 00000100:00100000:3.0:1788658504.420170:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:3.0:1788658504.420196:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11557:x1875544076534144:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1788658504.420446:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:11557:x1875544076534144:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 253us (385us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788658504.420453:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00010000:00010000:3.0:1788658504.448949:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658504.450203:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658504.450283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076534400 00000100:00100000:1.0:1788658504.450293:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076534400 00000100:00100000:1.0:1788658504.450384:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 191 00000100:00100000:1.0:1788658504.450406:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:11084:x1875544076534400:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1788658504.450431:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658504.450452:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb787 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b042 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.450567:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.450582:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 28 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.450592:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.450627:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 28 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.450640:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 28 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658504.450654:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700539880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103789824:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658504.450766:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658504.455007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658504.455219:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700539880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103789824:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658504.455242:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076534528 00000100:00100000:3.0:1788658504.455249:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076534528 00010000:00010000:2.0:1788658504.455249:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.455287:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 29 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.455322:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:3.0:1788658504.455332:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:2352:x1875544076534528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658504.455348:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658504.455355:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 29 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.455368:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 29 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.455391:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b03b expref: 29 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.455407:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658504.455412:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.455421:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.455439:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.455465:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658504.455512:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:2352:x1875544076534528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 181us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658504.455519:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00010000:00010000:2.0:1788658504.455646:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.455660:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658504.455702:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788658504.455844:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679600/0xf657f176650eb787 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.455860:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.455868:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:2.0:1788658504.455872:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658504.455874:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678000, rc 0) 00000100:00100000:2.0:1788658504.455908:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:11084:x1875544076534400:12345-192.168.202.3@tcp:101:bash.0 Request processed in 5505us (5712us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788658504.455916:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 191 00000100:00100000:1.0:1788658504.458015:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.459889:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076534784 00000100:00100000:3.0:1788658504.459902:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076534784 00000100:00100000:3.0:1788658504.460003:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:3.0:1788658504.460014:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:11084:x1875544076534784:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:3.0:1788658504.460282:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.460301:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.460313:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658504.460368:0:11367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1788658504.460395:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a83ecd2e reply state 000000003d2e4378 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.460404:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788658504.460451:0:11367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1788658504.460574:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:11084:x1875544076534784:12345-192.168.202.3@tcp:36:bash.0 Request processed in 561us (2566us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788658504.460581:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 192 00000020:00080000:3.0:1788658504.460599:0:11367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788658504.465259:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658504.465399:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076534912 00000100:00100000:2.0:1788658504.465409:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076534912 00000100:00100000:2.0:1788658504.465468:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 193 00000100:00100000:2.0:1788658504.465480:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:11084:x1875544076534912:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1788658504.465504:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658504.465525:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb7a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b049 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.465595:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b049 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.465632:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b049 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.465653:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:2.0:1788658504.465656:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658504.465660:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a600, rc 0) 00000100:00100000:2.0:1788658504.465785:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+33:11084:x1875544076534912:12345-192.168.202.3@tcp:101:bash.0 Request processed in 307us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658504.465792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 193 00010000:00010000:3.0:1788658504.466429:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.466440:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.466448:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.466454:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.466459:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.466467:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.466480:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658504.466483:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.466487:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.466493:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb79c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658504.474208:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658504.474301:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076535040 00000100:00100000:1.0:1788658504.474310:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076535040 00000100:00100000:1.0:1788658504.474385:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:1.0:1788658504.474397:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:11084:x1875544076535040:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1788658504.474430:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658504.474451:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b050 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658504.474478:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cc344, atime: 0x6a9cc343, ctime: 0x6a9cc344, blocks: 0xb 00010000:00010000:1.0:1788658504.474499:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788658504.474503:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658504.474512:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.474541:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.474554:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679000, rc 0) 00000100:00100000:1.0:1788658504.474613:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:11084:x1875544076535040:12345-192.168.202.3@tcp:101:bash.0 Request processed in 218us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658504.474619:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00080000:0.0:1788658504.474694:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658504.478690:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658504.480699:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076535168 00000100:00100000:0.0:1788658504.480714:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076535168 00002000:00010000:0.0:1788658504.480761:0:6690:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788658504.480767:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700539880 with x1875544076535168 ext(0->18446744073709551615) 00002000:00010000:0.0:1788658504.480778:0:6690:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5700539880. 00000100:00100000:0.0:1788658504.480810:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:0.0:1788658504.480821:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076535168:12345-192.168.202.3@tcp:10:bash.0 00002000:00010000:0.0:1788658504.481107:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788658504.481112:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788658500 -> 1788658504 00002000:00010000:0.0:1788658504.481128:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788658499 -> 1788658499 00002000:00010000:0.0:1788658504.481130:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788658500 -> 1788658504 00002000:00010000:0.0:1788658504.481133:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788658504.481207:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2352:x1875544076535168:12345-192.168.202.3@tcp:10:bash.0 Request processed in 387us (2526us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788658504.481215:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00002000:00010000:0.0:1788658504.481219:0:6690:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788658504.481222:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5700539880 with x1875544076535168 ext(0->18446744073709551615) 00002000:00010000:0.0:1788658504.481227:0:6690:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5700539880. 00000100:00100000:3.0:1788658504.579771:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658504.580174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076535296 00000100:00100000:2.0:1788658504.580186:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076535296 00000100:00100000:2.0:1788658504.580266:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 194 00000100:00100000:2.0:1788658504.580277:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:11571:x1875544076535296:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:2.0:1788658504.580357:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580376:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580389:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580405:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580412:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580437:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580724:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580734:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580741:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658504.580786:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580799:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580806:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580813:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.580819:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658504.581031:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581041:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581054:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658504.581064:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658504.581071:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581077:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581091:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581097:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581103:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581108:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658504.581112:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581118:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581127:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658504.581130:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658504.581133:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581139:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581155:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581166:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581172:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581177:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658504.581181:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581187:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581195:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:2.0:1788658504.581198:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658504.581201:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.581256:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658504.581400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:11571:x1875544076535296:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 1122us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658504.581409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 194 00000100:00100000:3.0:1788658504.605433:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658504.605458:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103789952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658504.605542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658504.605915:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103789952 00000100:00100000:1.0:1788658504.605924:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103789952 00000100:00100000:1.0:1788658504.605998:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658504.606009:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103789952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658504.606047:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658504.606108:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103789952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658504.606116:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658504.606260:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103789952:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788658504.606322:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658504.649657:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.649776:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076535552 00000100:00100000:3.0:1788658504.649800:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076535552 00000100:00100000:3.0:1788658504.649932:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 195 00000100:00100000:3.0:1788658504.650013:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+32:11574:x1875544076535552:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658504.650035:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658504.650057:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb7c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b057 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650134:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650150:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650163:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650177:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650185:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650192:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650460:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb7db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650471:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650479:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658504.650496:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788658504.650615:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.650623:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651193:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651203:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.651208:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651217:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651229:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658504.651232:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.651238:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651244:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb7cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651258:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651265:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651353:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651358:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.651362:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651368:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651376:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810300) 00010000:00010000:3.0:1788658504.651378:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.651382:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651387:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb7d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651433:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb7c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b057 expref: 35 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651447:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb7db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b057 expref: 34 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.651454:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658504.651456:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788658504.651458:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:3.0:1788658504.652796:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11574:x1875544076535552:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2844us (3139us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788658504.654144:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 195 00000100:00100000:1.0:1788658504.662391:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658504.662951:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076535680 00000100:00100000:0.0:1788658504.662962:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076535680 00000100:00100000:0.0:1788658504.663031:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 196 00000100:00100000:0.0:1788658504.663042:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11574:x1875544076535680:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1788658504.663111:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.663266:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.663283:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.663323:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.663339:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 34 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658504.663375:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103790080:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658504.663755:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658504.671755:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103790080:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658504.671788:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658504.677010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.677232:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076535936 00000100:00100000:3.0:1788658504.677243:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076535936 00000100:00100000:3.0:1788658504.677368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:3.0:1788658504.677380:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:5589:x1875544076535936:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788658504.677770:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+36:5589:x1875544076535936:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 391us (769us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788658504.677779:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1788658504.682094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658504.682243:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076536064 00000100:00100000:1.0:1788658504.682262:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076536064 00010000:00010000:1.0:1788658504.682308:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 36 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658504.682347:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:1.0:1788658504.682359:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56cad4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+36:2352:x1875544076536064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658504.682375:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658504.682383:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 36 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.682398:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 36 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.682423:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1678000/0xf657f176650eb78e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b042 expref: 36 pid: 5837 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.682442:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:1.0:1788658504.682449:0:7635:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.682458:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.682467:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.682553:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658504.682617:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56cad4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:2352:x1875544076536064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 260us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658504.682625:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00010000:00010000:3.0:1788658504.683381:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683394:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683427:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683434:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683441:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683446:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.683459:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683467:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683479:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658504.683482:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658504.683486:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.683492:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb7e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.683570:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11574:x1875544076535680:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 20528us (21187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658504.683579:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 196 00000100:00100000:0.0:1788658504.690782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658504.690898:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076536320 00000100:00100000:2.0:1788658504.690909:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076536320 00000100:00100000:2.0:1788658504.690966:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:2.0:1788658504.690978:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+34:11574:x1875544076536320:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1788658504.691247:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:11574:x1875544076536320:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 270us (473us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788658504.691267:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:1.0:1788658504.781369:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658504.781553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076536576 00000100:00100000:2.0:1788658504.781564:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076536576 00000100:00100000:2.0:1788658504.781628:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 197 00000100:00100000:2.0:1788658504.781639:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+35:11585:x1875544076536576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1788658504.781661:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658504.781727:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b05e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.781818:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.781834:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.781846:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.781862:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.781870:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.781877:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782174:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782195:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782203:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658504.782214:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788658504.782306:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782314:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782320:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782326:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658504.782330:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782338:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782350:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658504.782353:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658504.782358:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782364:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb7f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782375:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782387:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782392:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782397:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658504.782400:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782407:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782414:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658504.782417:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658504.782420:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782425:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb7fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782468:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb7f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b05e expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782482:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b05e expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.782490:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:2.0:1788658504.782528:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658504.782537:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ac00, rc 0) 00000100:00100000:2.0:1788658504.782593:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:11585:x1875544076536576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 956us (1234us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788658504.782601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 197 00000100:00100000:1.0:1788658504.789518:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658504.789630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076536832 00000100:00100000:2.0:1788658504.789641:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076536832 00000100:00100000:2.0:1788658504.789728:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:2.0:1788658504.789738:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:11585:x1875544076536832:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1788658504.789978:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:11585:x1875544076536832:12345-192.168.202.3@tcp:35:cat.0 Request processed in 241us (486us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788658504.789986:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:0.0:1788658504.811259:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.811350:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076537088 00000100:00100000:3.0:1788658504.811360:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076537088 00000100:00100000:3.0:1788658504.811412:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 198 00000100:00100000:3.0:1788658504.811422:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:11586:x1875544076537088:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:3.0:1788658504.811475:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788658504.811514:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb805 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b05e expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811539:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb7db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b057 expref: 37 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811553:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a600/0xf657f176650eb7a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b049 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811578:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658504.811589:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658504.811610:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811624:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811633:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811647:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811654:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811661:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811963:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811971:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.811979:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658504.812456:0:11367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788658504.812464:0:11367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395951798816ns, next at 396951796821ns, rc = 0 00010000:00010000:3.0:1788658504.812541:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812551:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812559:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812566:0:11367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812573:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812579:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812596:0:11367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658504.812614:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812620:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812627:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812632:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.812636:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812644:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812660:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810200) 00010000:00010000:3.0:1788658504.812688:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788658504.812693:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812700:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb821 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812716:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812721:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812726:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812731:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.812733:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812739:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812745:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658504.812747:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.812750:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.812755:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb813 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658504.812774:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4e64004 reply state 000000007f022f27 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.812782:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658504.812855:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+37:11586:x1875544076537088:12345-192.168.202.3@tcp:36:rm.0 Request processed in 1431us (1601us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788658504.812863:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 198 00010000:00010000:0.0:1788658504.813239:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658504.813246:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.813253:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658504.813257:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.813265:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.813275:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e56d0810200) 00010000:00010000:0.0:1788658504.813278:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788658504.813281:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.813287:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb828 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658504.813301:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658504.813303:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658504.813305:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658504.817315:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.817334:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.817343:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.817348:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658504.817353:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.817362:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.817379:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810300) 00010000:00010000:2.0:1788658504.817382:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658504.817401:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658504.817408:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb81a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658504.845016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.845328:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076537344 00000100:00100000:3.0:1788658504.845339:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076537344 00000100:00100000:3.0:1788658504.845404:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 199 00000100:00100000:3.0:1788658504.845414:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+36:11592:x1875544076537344:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658504.845435:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658504.845451:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb82f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b065 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.846213:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.846231:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.846242:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.846257:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.846263:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.846281:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658504.847289:0:6710:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788658504.847451:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847463:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847472:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847576:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847585:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847592:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847598:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.847603:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847611:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847622:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658504.847625:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.847638:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.847644:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef200/0xf657f176650eb836 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658504.847658:0:6710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008da342b0 reply state 00000000e9d8434c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.847959:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788658504.848004:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb82f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 39 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.848020:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 38 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.848029:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:3.0:1788658504.848032:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658504.848034:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eee00, rc 0) 00000100:00100000:3.0:1788658504.848104:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:11592:x1875544076537344:12345-192.168.202.3@tcp:101:bash.0 Request processed in 2691us (3100us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788658504.848110:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 199 00010000:00010000:3.0:1788658504.850750:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.850766:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.850773:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658504.850794:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1788658504.850802:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658504.850807:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.850815:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.850831:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810500) 00010000:00010000:3.0:1788658504.850834:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658504.850839:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.850845:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb83d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658504.850934:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076537472 00000100:00100000:1.0:1788658504.850944:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076537472 00000100:00100000:1.0:1788658504.851005:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:1.0:1788658504.851015:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2352:x1875544076537472:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1788658504.851032:0:10289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658504.851049:0:10289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b06c expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658504.851074:0:10289:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658504.851091:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788658504.851096:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658504.851105:0:10289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 6 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.851122:0:10289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 6 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.851134:0:10289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678000, rc 0) 00000100:00100000:1.0:1788658504.851190:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2352:x1875544076537472:12345-192.168.202.3@tcp:101:bash.0 Request processed in 177us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658504.851203:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00080000:0.0:1788658504.851257:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658504.852949:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.853010:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076537600 00000100:00100000:3.0:1788658504.853016:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076537600 00000100:00100000:3.0:1788658504.853055:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:3.0:1788658504.853065:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:11592:x1875544076537600:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658504.853079:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658504.853093:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b073 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.853117:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 7 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.853124:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658504.853127:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658504.853141:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.853170:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 7 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.853181:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 7 pid: 10289 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.853191:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103790208:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658504.853354:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658504.855334:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875544103790208:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658504.855371:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658504.855391:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef200, rc 0) 00000100:00100000:1.0:1788658504.855437:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:11592:x1875544076537600:12345-192.168.202.3@tcp:101:bash.0 Request processed in 2374us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658504.855446:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:0.0:1788658504.856142:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.856220:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076537728 00000100:00100000:3.0:1788658504.856228:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076537728 00010000:00010000:3.0:1788658504.856274:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 7 pid: 10289 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.856311:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:3.0:1788658504.856320:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076537728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658504.856335:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658504.856358:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 7 pid: 10289 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.856372:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 7 pid: 10289 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.856394:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eefb6f60/0xf657f176650eb852 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b06c expref: 7 pid: 10289 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.856424:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658504.856429:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658504.856438:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.856449:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658504.856496:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658504.856519:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1875544103790336:192.168.202.3@tcp:105: 00000100:00100000:3.0:1788658504.857761:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658504.859946:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1875544103790336:192.168.202.3@tcp:105: 00010000:00010000:1.0:1788658504.859973:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658504.860070:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2351:x1875544076537728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3750us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658504.860080:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:0.0:1788658504.861406:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658504.862114:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076537984 00000100:00100000:1.0:1788658504.862124:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076537984 00000100:00100000:1.0:1788658504.862219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:1.0:1788658504.862229:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+38:11592:x1875544076537984:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:1.0:1788658504.862996:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:11592:x1875544076537984:12345-192.168.202.3@tcp:35:bash.0 Request processed in 764us (1591us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788658504.863005:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:2.0:1788658504.871577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.871621:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076538240 00000100:00100000:2.0:1788658504.871624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658504.871631:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076538240 00000100:00100000:3.0:1788658504.871765:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 150 00000100:00100000:3.0:1788658504.871777:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076538240:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658504.871863:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076538240:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658504.871870:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 150 00000100:00100000:0.0:1788658504.871938:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076538112 00000100:00100000:0.0:1788658504.871943:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076538112 00000100:00100000:0.0:1788658504.871974:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 295 00000100:00100000:0.0:1788658504.871981:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076538112:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658504.872011:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076538112:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658504.872017:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 295 00000100:00080000:1.0:1788658504.872223:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658505.031518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.031781:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076538368 00000100:00100000:2.0:1788658505.031792:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076538368 00000100:00100000:2.0:1788658505.031856:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 200 00000100:00100000:2.0:1788658505.031865:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+39:11608:x1875544076538368:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658505.031889:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.032156:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b07a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.032231:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.032246:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.032260:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658505.032294:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788658505.032298:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658505.032316:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.032341:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b07a expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.032372:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b07a expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.032380:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658505.032383:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658505.032387:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a800, rc 0) 00000100:00100000:2.0:1788658505.033145:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:11608:x1875544076538368:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 582us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.033158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 200 00000100:00100000:0.0:1788658505.036238:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.036322:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076538624 00000100:00100000:3.0:1788658505.036332:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076538624 00000100:00100000:3.0:1788658505.036391:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 201 00000100:00100000:3.0:1788658505.036401:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+40:11608:x1875544076538624:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658505.036429:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658505.036450:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb86e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b081 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.036560:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.036575:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.036587:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658505.036597:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788658505.036769:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb86e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b081 expref: 43 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.036799:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b081 expref: 42 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.036808:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:3.0:1788658505.036811:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658505.036815:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee600, rc 0) 00000100:00100000:3.0:1788658505.036875:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+42:11608:x1875544076538624:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 476us (647us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788658505.036882:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 201 00000100:00100000:1.0:1788658505.045345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.045469:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076538752 00000100:00100000:2.0:1788658505.045481:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076538752 00000100:00100000:2.0:1788658505.045550:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:2.0:1788658505.045560:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+42:2351:x1875544076538752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658505.045576:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658505.045601:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee600/0xf657f176650eb875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b081 expref: 42 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.045622:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:2.0:1788658505.045627:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658505.045732:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+41:2351:x1875544076538752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 173us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.045740:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1788658505.046366:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.047075:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076539008 00000100:00100000:2.0:1788658505.047084:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076539008 00000100:00100000:2.0:1788658505.047134:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 202 00000100:00100000:2.0:1788658505.047143:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+41:11608:x1875544076539008:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658505.047179:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.047198:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb883 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b088 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.047303:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb88a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.047315:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb88a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.047326:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb88a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658505.047337:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788658505.047457:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb883 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b088 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.047998:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb88a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b088 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.048006:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:2.0:1788658505.048009:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788658505.048012:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891be00, rc 0) 00000100:00100000:2.0:1788658505.048075:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:11608:x1875544076539008:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 933us (1710us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788658505.048083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 202 00000100:00100000:3.0:1788658505.055402:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.055516:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076539136 00000100:00100000:2.0:1788658505.055527:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076539136 00000100:00100000:2.0:1788658505.055589:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:2.0:1788658505.055616:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+6:2353:x1875544076539136:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1788658505.055662:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.055717:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.055726:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788658505.055730:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658505.055735:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.055780:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.055794:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 6 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.055808:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875544103790464:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658505.055894:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658505.063792:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.064022:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076539264 00000100:00100000:3.0:1788658505.064042:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076539264 00002000:00100000:3.0:1788658505.064100:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e570053b480 x1875544076539264/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:96/0 lens 504/0 e 0 to 0 dl 1788658516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788658505.064111:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e570053b480 with x1875544076539264 ext(0->8) 00010000:00010000:3.0:1788658505.064122:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 7 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.064141:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 7 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658505.064148:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e570053b480 00000100:00100000:3.0:1788658505.064182:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:3.0:1788658505.064191:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570053b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076539264:12345-192.168.202.3@tcp:4:lfs.0 00000100:00100000:3.0:1788658505.064743:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570053b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2352:x1875544076539264:12345-192.168.202.3@tcp:4:lfs.0 Request processed in 551us (973us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788658505.064751:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00002000:00100000:3.0:1788658505.064760:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e570053b480 x1875544076539264/t4294967308(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:96/0 lens 504/448 e 0 to 0 dl 1788658516 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788658505.064769:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e570053b480 with x1875544076539264 ext(0->8) 00010000:00010000:3.0:1788658505.064775:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 9 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.064787:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 9 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658505.064795:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e570053b480 00000100:00100000:2.0:1788658505.066404:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875544103790464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658505.066433:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.071943:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658505.072002:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076539392 00000100:00100000:1.0:1788658505.072026:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076539392 00010000:00010000:1.0:1788658505.072067:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 9 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658505.072114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:1.0:1788658505.072124:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2354:x1875544076539392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658505.072140:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788658505.072160:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788658505.072163:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788658504 00002000:00010000:1.0:1788658505.072165:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788658504 00002000:00010000:1.0:1788658505.072167:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788658504 00010000:00010000:1.0:1788658505.072173:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 9 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.072187:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 9 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.072213:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650eb859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b073 expref: 9 pid: 6687 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.072230:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658505.072234:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658505.072240:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.072250:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.072301:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658505.072363:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2354:x1875544076539392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 240us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658505.072371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00010000:00010000:2.0:1788658505.072911:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.072933:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.072962:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.072971:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.072980:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.072988:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658505.072993:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.073003:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.073017:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.073025:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b7273fa/0xf657f176650eb898 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.073101:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076539136:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 17486us (17707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.073109:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:0.0:1788658505.077600:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.077858:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076539648 00000100:00100000:3.0:1788658505.077869:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076539648 00000100:00100000:3.0:1788658505.077931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:3.0:1788658505.077941:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+43:11608:x1875544076539648:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:3.0:1788658505.078001:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb88a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b088 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658505.078937:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788658505.078995:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788658505.081813:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1788658505.081910:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.081932:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 47 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.081942:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.081999:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 47 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.082019:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 47 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658505.082033:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875544103790592:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658505.082192:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658505.091098:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.091143:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875544103790592:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658505.091271:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076539776 00010000:00010000:3.0:1788658505.091274:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.091280:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076539776 00010000:00010000:2.0:1788658505.091320:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 48 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.091357:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:2.0:1788658505.091368:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+48:2352:x1875544076539776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658505.091382:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658505.091389:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 48 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.091402:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 48 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.091426:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eee00/0xf657f176650eb844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b065 expref: 48 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.091443:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:2.0:1788658505.091448:0:7635:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.091468:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.091488:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.091514:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658505.091538:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.091548:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.091578:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+47:2352:x1875544076539776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 210us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.091587:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00000001:00080000:3.0:1788658505.096866:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788658505.097087:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788658505.097735:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103790720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788658505.098580:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658505.098910:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658505.098986:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103790720 00000100:00100000:0.0:1788658505.098994:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103790720 00000100:00100000:0.0:1788658505.099091:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658505.099098:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875544103790720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788658505.099184:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875544103790720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.099190:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658505.099441:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faebb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103790720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788658505.100008:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788658505.100090:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103790848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788658505.100132:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658505.100165:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8800480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658505.100362:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103790848 00000100:00100000:0.0:1788658505.100368:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103790848 00000100:00100000:0.0:1788658505.100397:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658505.100405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875544103790848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788658505.101702:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875544103790848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1291us (1563us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788658505.101724:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658505.101777:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875544103790848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788658505.101849:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788658505.101892:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.101903:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.101911:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.101917:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658505.101921:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.101930:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.101950:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:3.0:1788658505.101953:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788658505.101958:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.101964:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb89f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658505.102126:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788658505.102211:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788658505.102219:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396241553917ns, next at 397241552300ns, rc = 0 00000001:00080000:3.0:1788658505.102224:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788658505.102253:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d0810000) 00010000:00010000:3.0:1788658505.102256:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788658505.102263:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb88a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b088 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658505.102342:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:11608:x1875544076539648:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 24403us (24750us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788658505.102349:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00000020:00080000:3.0:1788658505.102353:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1788658505.102779:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658505.105240:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.105345:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076539904 00000100:00100000:2.0:1788658505.105355:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076539904 00000100:00100000:2.0:1788658505.105412:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 203 00000100:00100000:2.0:1788658505.105422:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+50:11608:x1875544076539904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658505.105445:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.105480:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb8a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b08f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.105543:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b08f expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.105559:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b08f expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.105606:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.105609:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658505.105613:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b200, rc 0) 00000100:00100000:2.0:1788658505.105706:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:11608:x1875544076539904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 284us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.105714:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 203 00000100:00100000:3.0:1788658505.107727:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658505.107793:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076540160 00000100:00100000:1.0:1788658505.107802:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076540160 00000100:00100000:1.0:1788658505.107864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:1.0:1788658505.107873:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+51:11608:x1875544076540160:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658505.108105:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11608:x1875544076540160:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 233us (388us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788658505.108114:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1788658505.116945:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103791232:0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.117017:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658505.117065:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658505.117071:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103791104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.117094:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658505.117131:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103791232 00000100:00100000:0.0:1788658505.117140:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103791232 00000100:00100000:3.0:1788658505.117149:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103790976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658505.117196:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658505.117197:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103791104 00000100:00100000:0.0:1788658505.117202:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103791104 00000100:00100000:0.0:1788658505.117235:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788658505.117238:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103791488:0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.117247:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103791232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658505.117268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658505.117313:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103791232:12345-0@lo:400:kworker.0 Request processed in 68us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658505.117315:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658505.117326:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103791360:0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.117327:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788658505.117387:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103791232:0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.117413:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103791488 00000100:00080000:1.0:1788658505.117417:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658505.117417:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103791488 00000100:00100000:1.0:1788658505.117438:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788658505.117448:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103791104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.117486:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788658505.117494:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103791488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658505.117558:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103790976 00000100:00100000:2.0:1788658505.117564:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103790976 00000100:00100000:2.0:1788658505.117595:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788658505.117602:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103790976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658505.123866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658505.124319:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103791360 00000100:00100000:1.0:1788658505.124329:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103791360 00000100:00100000:1.0:1788658505.124394:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658505.124405:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103791360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.124426:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103791488:12345-0@lo:400:kworker.0 Request processed in 6929us (7154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.124439:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788658505.125023:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3305:x1875544103790976:12345-0@lo:400:kworker.0 Request processed in 7418us (7825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.125033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788658505.125199:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103790976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658505.125219:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103791488:0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.125247:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103791104:12345-0@lo:400:kworker.0 Request processed in 7798us (8148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.125258:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788658505.125325:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103791104:0@lo:400:kworker.0 00000100:00100000:1.0:1788658505.125416:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103791360:12345-0@lo:400:kworker.0 Request processed in 1013us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658505.125424:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788658505.125445:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658505.133248:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56c834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103791360:0@lo:400:kworker.0 00000100:00100000:0.0:1788658505.163093:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.163202:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076540288 00000100:00100000:3.0:1788658505.163211:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076540288 00000100:00100000:3.0:1788658505.163270:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 204 00000100:00100000:3.0:1788658505.163281:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11618:x1875544076540288:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:3.0:1788658505.163349:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163363:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163372:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163381:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163386:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163389:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163490:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163508:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163516:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658505.163559:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163572:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163579:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163585:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163592:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658505.163596:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163604:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163627:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658505.163630:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658505.163634:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163641:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb8ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163716:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163723:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163729:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163733:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658505.163737:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163745:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163753:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810000) 00010000:00010000:3.0:1788658505.163811:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658505.163856:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163860:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb8b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163873:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163877:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163880:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163890:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658505.163892:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163896:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163900:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:3.0:1788658505.163902:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658505.163904:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.163907:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb8bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658505.164039:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11618:x1875544076540288:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 757us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658505.164061:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 204 00000100:00100000:2.0:1788658505.209871:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.209943:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076540544 00000100:00100000:0.0:1788658505.209964:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076540544 00000100:00100000:0.0:1788658505.210034:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 205 00000100:00100000:0.0:1788658505.210046:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+52:11621:x1875544076540544:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658505.210078:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658505.210100:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b096 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210178:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210194:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210205:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210220:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210227:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210234:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210353:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210379:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210387:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658505.210399:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788658505.210988:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.210997:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211003:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211009:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658505.211013:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211019:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211030:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658505.211033:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658505.211037:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211043:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb8c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211055:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211079:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211084:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211088:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658505.211091:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211097:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211104:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56c3c69b00) 00010000:00010000:0.0:1788658505.211106:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658505.211109:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211114:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb8d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211161:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 55 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211176:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 54 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.211183:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658505.211185:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658505.211194:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78c00, rc 0) 00000100:00100000:0.0:1788658505.211266:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:11621:x1875544076540544:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1222us (1404us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788658505.211273:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 205 00000100:00100000:2.0:1788658505.215009:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.215130:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076540672 00000100:00100000:0.0:1788658505.215140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076540672 00000100:00100000:0.0:1788658505.215246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 206 00000100:00100000:0.0:1788658505.215257:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:11621:x1875544076540672:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1788658505.215325:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215342:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215353:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215378:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215385:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215392:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215397:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658505.215402:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215409:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215436:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658505.215439:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658505.215455:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.215462:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.215581:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:11621:x1875544076540672:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 326us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.215589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 206 00000100:00100000:3.0:1788658505.217406:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658505.218583:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076540928 00000100:00100000:1.0:1788658505.218593:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076540928 00000100:00100000:1.0:1788658505.218684:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:1.0:1788658505.218697:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+54:11621:x1875544076540928:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658505.218935:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:11621:x1875544076540928:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 240us (1536us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788658505.218943:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:1.0:1788658505.292865:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.293567:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076541184 00000100:00100000:0.0:1788658505.293580:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076541184 00000100:00100000:0.0:1788658505.293799:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 207 00000100:00100000:0.0:1788658505.293811:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:11631:x1875544076541184:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658505.293836:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658505.293839:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788658505.293866:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b07a expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.293886:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658505.293891:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658505.293903:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b09d expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.293997:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.294029:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 55 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.294037:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.294067:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 55 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.294080:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 55 pid: 11367 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.294092:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103791616:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658505.294192:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c81969c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658505.300075:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103791616:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658505.300105:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658505.303838:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.304149:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076541312 00000100:00100000:2.0:1788658505.304159:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076541312 00010000:00010000:2.0:1788658505.304200:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 56 pid: 11367 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.304243:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:2.0:1788658505.304253:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+56:2351:x1875544076541312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658505.304267:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658505.304274:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 56 pid: 11367 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.304305:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 56 pid: 11367 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.304327:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650eb8d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b096 expref: 56 pid: 11367 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.304343:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.304348:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.304358:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.304365:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.304395:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658505.304462:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:2351:x1875544076541312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 210us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.304470:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00010000:00010000:0.0:1788658505.304536:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.304544:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658505.304563:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788658505.304759:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb8ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 56 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.304787:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.304794:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658505.304797:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658505.304800:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78200, rc 0) 00000100:00100000:0.0:1788658505.304826:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:11631:x1875544076541184:12345-192.168.202.3@tcp:101:bash.0 Request processed in 11019us (11971us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788658505.304833:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 207 00000100:00100000:2.0:1788658505.308096:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.308343:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076541568 00000100:00100000:0.0:1788658505.308354:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076541568 00000100:00100000:0.0:1788658505.308412:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 208 00000100:00100000:0.0:1788658505.308422:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56faebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+55:11631:x1875544076541568:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:0.0:1788658505.308717:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.308736:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.308761:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658505.308811:0:11367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1788658505.308836:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000555789e7 reply state 00000000aab8a2c9 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.308845:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658505.308937:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56faebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11631:x1875544076541568:12345-192.168.202.3@tcp:36:bash.0 Request processed in 515us (848us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788658505.308945:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 208 00000020:00080000:0.0:1788658505.308950:0:11367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788658505.312235:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.312311:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076541696 00000100:00100000:0.0:1788658505.312321:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076541696 00000100:00100000:0.0:1788658505.312384:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:0.0:1788658505.312396:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11631:x1875544076541696:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658505.312421:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658505.312452:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb908 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0a4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.312531:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.312544:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 59 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.312551:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.312557:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.312574:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.312601:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 59 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.312633:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 59 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.312646:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103791744:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658505.312763:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196480 going to sleep for 11 seconds 00010000:00010000:2.0:1788658505.313082:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.313091:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.313098:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.313115:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.313118:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.313126:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.313140:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.313143:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.313145:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.313153:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.313159:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb901 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658505.316607:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.316862:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103791744:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658505.316888:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658505.317393:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076541824 00000100:00100000:3.0:1788658505.317400:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076541824 00010000:00010000:3.0:1788658505.317448:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 59 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658505.317524:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:3.0:1788658505.317534:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:2352:x1875544076541824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658505.317549:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658505.317557:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 59 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.317568:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 59 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.317615:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650eb8f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b09d expref: 59 pid: 6710 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.317633:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:3.0:1788658505.317637:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.317646:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.317654:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.317706:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658505.317760:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:2352:x1875544076541824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 228us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658505.317768:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00010000:00010000:0.0:1788658505.317825:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.317833:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658505.317873:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788658505.317877:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658505.317894:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.317921:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.317935:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.317942:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658505.317950:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658505.317953:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658505.317975:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11631:x1875544076541696:12345-192.168.202.3@tcp:101:bash.0 Request processed in 5583us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.317983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:1.0:1788658505.324401:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.324487:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076542080 00000100:00100000:3.0:1788658505.324496:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076542080 00000100:00100000:3.0:1788658505.324553:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:3.0:1788658505.324564:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+57:11631:x1875544076542080:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:3.0:1788658505.326899:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11631:x1875544076542080:12345-192.168.202.3@tcp:35:bash.0 Request processed in 2327us (2496us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788658505.326912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:1.0:1788658505.408929:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.409238:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076542208 00000100:00100000:0.0:1788658505.409250:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076542208 00000100:00100000:0.0:1788658505.409317:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:0.0:1788658505.409328:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+58:11637:x1875544076542208:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658505.409352:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658505.409374:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0ab expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.409473:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb91d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.409488:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb91d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.409499:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb91d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658505.409534:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788658505.409538:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658505.409554:0:6710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb91d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.409590:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ab expref: 60 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.409629:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb91d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ab expref: 59 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.409637:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658505.409640:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658505.409643:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78a00, rc 0) 00000100:00100000:0.0:1788658505.409758:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11637:x1875544076542208:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 432us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.409765:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:1.0:1788658505.414267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.414363:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076542336 00000100:00100000:2.0:1788658505.414373:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076542336 00000100:00100000:2.0:1788658505.414441:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:2.0:1788658505.414452:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11637:x1875544076542336:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658505.414472:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.414494:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb924 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0b2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414561:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414575:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414613:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414628:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414635:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414640:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414759:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414768:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414774:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658505.414810:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788658505.414815:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658505.414834:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414846:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414853:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414868:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414874:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414880:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ae00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.414885:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414893:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414904:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658505.414907:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.414912:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414917:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb92b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414929:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414934:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414939:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414944:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.414953:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414960:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414967:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d579cf00) 00010000:00010000:2.0:1788658505.414970:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.414972:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.414977:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.415009:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb924 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b2 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.415021:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b2 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.415028:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.415030:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658505.415033:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891be00, rc 0) 00000100:00100000:2.0:1788658505.415084:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11637:x1875544076542336:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 634us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.415091:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:3.0:1788658505.421125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.421183:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.421281:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076542720 00000100:00100000:2.0:1788658505.421291:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076542720 00000100:00100000:0.0:1788658505.421294:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076542592 00000100:00100000:0.0:1788658505.421298:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076542592 00000100:00100000:2.0:1788658505.421342:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:0.0:1788658505.421349:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:2.0:1788658505.421352:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56cad4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:2352:x1875544076542720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788658505.421355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11637:x1875544076542592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658505.421371:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.421376:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658505.421389:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb940 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0b9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.421396:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b2 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.421410:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.421414:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658505.421481:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56cad4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:2352:x1875544076542720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.421488:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00010000:00010000:0.0:1788658505.421494:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.421517:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.421525:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.421557:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.421578:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 60 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.421592:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103791872:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658505.421645:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658505.424344:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57014bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875544103791872:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658505.424373:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658505.425867:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.426055:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076542848 00000100:00100000:2.0:1788658505.426065:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076542848 00010000:00010000:2.0:1788658505.426103:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 61 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.426145:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:2.0:1788658505.426155:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:2351:x1875544076542848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658505.426169:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658505.426175:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 61 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.426188:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 61 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.426223:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb90f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0a4 expref: 61 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.426239:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.426252:0:7635:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.426262:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.426270:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.426304:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658505.426361:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:2351:x1875544076542848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 207us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.426370:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00010000:00010000:1.0:1788658505.426438:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.426446:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658505.426465:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788658505.426609:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eb940 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.426626:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.426644:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:1.0:1788658505.426647:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788658505.426649:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79e00, rc 0) 00000100:00100000:1.0:1788658505.426727:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11637:x1875544076542592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5371us (5613us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788658505.426735:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:3.0:1788658505.431146:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.431249:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076543104 00000100:00100000:2.0:1788658505.431258:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076543104 00000100:00100000:2.0:1788658505.431332:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1788658505.431343:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11637:x1875544076543104:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:2.0:1788658505.431359:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658505.431382:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650eb8a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b08f expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.431397:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.431402:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658505.431468:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11637:x1875544076543104:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 127us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.431475:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1788658505.435357:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.435414:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076543232 00000100:00100000:2.0:1788658505.435442:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076543232 00000100:00100000:2.0:1788658505.435504:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 213 00000100:00100000:2.0:1788658505.435530:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57014bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11637:x1875544076543232:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:2.0:1788658505.435638:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.435656:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.435703:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658505.435912:0:11367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788658505.436004:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57014bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11637:x1875544076543232:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 477us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.436011:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 213 00000100:00100000:0.0:1788658505.440519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.440592:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076543360 00000100:00100000:3.0:1788658505.440602:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076543360 00000100:00100000:3.0:1788658505.440701:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 214 00000100:00100000:3.0:1788658505.440713:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+59:11637:x1875544076543360:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658505.440743:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658505.440764:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.441040:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.441052:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.441070:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.441081:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.441094:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:3.0:1788658505.441097:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658505.441100:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.441107:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef000, rc 0) 00000100:00100000:3.0:1788658505.441165:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11637:x1875544076543360:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 454us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658505.441185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 214 00010000:00010000:2.0:1788658505.502713:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658505.632031:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103792000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658505.632107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658505.632285:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103792000 00000100:00100000:1.0:1788658505.632295:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103792000 00000100:00100000:1.0:1788658505.632349:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788658505.632359:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103792000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658505.632382:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658505.632455:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103792000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658505.632462:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788658505.632825:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103792000:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788658505.695350:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658505.695360:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658505.695411:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:1.0:1788658505.695418:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658505.695547:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700d72300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103792128:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658505.695696:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658505.706999:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700d72300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103792128:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658505.726395:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658505.726498:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076543488 00000100:00100000:1.0:1788658505.726509:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076543488 00000100:00100000:1.0:1788658505.726584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:1.0:1788658505.726596:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11638:x1875544076543488:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658505.726629:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658505.727009:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11638:x1875544076543488:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 413us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658505.727017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:0.0:1788658505.735231:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.735366:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076543616 00000100:00100000:2.0:1788658505.735378:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076543616 00000100:00100000:2.0:1788658505.735454:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:2.0:1788658505.735464:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11638:x1875544076543616:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.735554:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735575:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735588:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735607:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735635:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735643:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735714:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735722:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735729:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658505.735783:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788658505.735787:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658505.735802:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735814:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735820:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735828:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735834:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.735839:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735853:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735868:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:2.0:1788658505.735871:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.735877:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735884:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb963 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735900:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735906:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735912:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735917:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.735919:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735924:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735931:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9e56d579cf00) 00010000:00010000:2.0:1788658505.735933:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.735936:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735952:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb96a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735969:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735975:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735980:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735985:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ae00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.735988:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.735994:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.736001:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.736003:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.736006:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.736011:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.736104:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11638:x1875544076543616:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 639us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.736113:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:3.0:1788658505.740315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.740410:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076543872 00000100:00100000:2.0:1788658505.740420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076543872 00000100:00100000:2.0:1788658505.740491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:2.0:1788658505.740500:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+60:11638:x1875544076543872:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.740521:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.740551:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb978 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0c7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.740651:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741174:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741190:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658505.741201:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788658505.741301:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741310:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741316:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741321:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.741325:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741332:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741359:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658505.741362:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788658505.741367:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741372:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb97f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741426:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb978 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c7 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741437:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:2.0:1788658505.741439:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658505.741443:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb978 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c7 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.741451:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b600, rc 0) 00000100:00100000:2.0:1788658505.741571:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11638:x1875544076543872:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1071us (1264us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1788658505.741579:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:1.0:1788658505.755861:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.756421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076544000 00000100:00100000:0.0:1788658505.756432:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076544000 00000100:00100000:0.0:1788658505.756491:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 218 00000100:00100000:0.0:1788658505.756502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11638:x1875544076544000:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788658505.756547:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788658505.756654:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11638:x1875544076544000:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 154us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.756662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 218 00000100:00100000:0.0:1788658505.764637:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.764968:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076544256 00000100:00100000:3.0:1788658505.764980:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076544256 00000100:00100000:3.0:1788658505.765042:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:3.0:1788658505.765053:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11638:x1875544076544256:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658505.765075:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658505.765078:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788658505.765106:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78a00/0xf657f176650eb91d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ab expref: 61 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.765127:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:3.0:1788658505.765132:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658505.765145:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb98d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0ce expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658505.765563:0:6710:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788658505.769991:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.770016:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.770029:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.770113:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eb98d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ce expref: 63 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.772113:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ce expref: 62 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.772137:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:3.0:1788658505.772140:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658505.772144:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:3.0:1788658505.772241:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11638:x1875544076544256:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 7185us (7612us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788658505.772251:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:3.0:1788658505.779913:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.780127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076544512 00000100:00100000:2.0:1788658505.780138:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076544512 00000100:00100000:2.0:1788658505.780213:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 220 00000100:00100000:2.0:1788658505.780225:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11638:x1875544076544512:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.780281:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658505.780317:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eb994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ce expref: 62 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.780360:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d0810500) 00010000:00010000:2.0:1788658505.780370:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658505.780402:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.780415:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.780424:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.780439:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.780446:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.780452:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.780527:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782040:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782052:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782058:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.782062:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782086:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782100:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:2.0:1788658505.782103:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.782108:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782115:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eb9a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782130:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782136:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782142:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782147:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.782149:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782169:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782176:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb2294a88 (ffff9e56d579cf00) 00010000:00010000:2.0:1788658505.782179:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658505.782181:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.782196:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eb9a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb2294a88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.782307:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11638:x1875544076544512:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 2080us (2399us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658505.782316:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 220 00000100:00100000:1.0:1788658505.787352:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.787581:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076544640 00000100:00100000:2.0:1788658505.787592:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076544640 00000100:00100000:2.0:1788658505.787997:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 221 00000100:00100000:2.0:1788658505.788010:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+61:11638:x1875544076544640:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.788030:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.788055:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0d5 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.788090:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.788103:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.788113:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.788219:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 63 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.788239:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 62 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.788260:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:2.0:1788658505.788263:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788658505.788268:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a000, rc 0) 00000100:00100000:2.0:1788658505.788330:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11638:x1875544076544640:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 323us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.788337:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 221 00000100:00100000:3.0:1788658505.791568:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.792590:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076544896 00000100:00100000:2.0:1788658505.792602:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076544896 00000100:00100000:2.0:1788658505.792694:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 222 00000100:00100000:2.0:1788658505.792845:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+62:11638:x1875544076544896:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.792932:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.792950:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.792962:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658505.793346:0:11367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788658505.793543:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043e57749 reply state 000000009add6f91 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.793554:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658505.793660:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+64:11638:x1875544076544896:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 955us (2227us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788658505.793891:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 222 00000100:00100000:3.0:1788658505.797833:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.797893:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076545024 00000100:00100000:0.0:1788658505.797904:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076545024 00000100:00100000:0.0:1788658505.797972:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 223 00000100:00100000:0.0:1788658505.797998:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+64:11638:x1875544076545024:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.798009:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.798023:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.798032:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.798035:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.798039:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658505.798045:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.798052:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.798056:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.798070:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:2.0:1788658505.798074:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788658505.798079:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.798086:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.798121:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.798136:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.798159:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:0.0:1788658505.798162:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658505.798165:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78400, rc 0) 00000100:00100000:0.0:1788658505.798228:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+64:11638:x1875544076545024:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 233us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.798236:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 223 00000100:00100000:3.0:1788658505.801412:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.801721:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076545152 00000100:00100000:2.0:1788658505.801731:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076545152 00000100:00100000:2.0:1788658505.801790:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:2.0:1788658505.801801:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2351:x1875544076545152:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788658505.802105:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2351:x1875544076545152:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 305us (704us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788658505.802113:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:3.0:1788658505.809751:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.809858:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076545408 00000100:00100000:2.0:1788658505.809869:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076545408 00000100:00100000:2.0:1788658505.809936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:2.0:1788658505.809948:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+64:11638:x1875544076545408:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658505.810181:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+65:11638:x1875544076545408:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 235us (439us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788658505.810188:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1788658505.816559:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658505.816658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076545664 00000100:00100000:1.0:1788658505.816712:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076545664 00000100:00100000:1.0:1788658505.816764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 224 00000100:00100000:1.0:1788658505.816774:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+65:11638:x1875544076545664:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788658505.816887:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+65:11638:x1875544076545664:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658505.816895:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 224 00000100:00100000:3.0:1788658505.838824:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.838958:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076545792 00000100:00100000:2.0:1788658505.838969:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076545792 00000100:00100000:2.0:1788658505.839083:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 225 00000100:00100000:2.0:1788658505.839093:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+65:11638:x1875544076545792:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.839113:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.839133:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0e3 expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.839306:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.839321:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.839333:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658505.839367:0:11367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658505.839422:0:11367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.839503:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eb9cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0e3 expref: 67 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.839528:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0e3 expref: 66 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.839536:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:2.0:1788658505.839539:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788658505.839543:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ae00, rc 0) 00000100:00100000:2.0:1788658505.839826:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+66:11638:x1875544076545792:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 732us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.839834:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 225 00000100:00100000:3.0:1788658505.842780:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658505.843822:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076545920 00000100:00100000:1.0:1788658505.843833:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076545920 00000100:00100000:1.0:1788658505.844302:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:1.0:1788658505.844316:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+10:2351:x1875544076545920:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658505.844334:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658505.844357:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0ea expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658505.844393:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc349, blocks: 0x1 00010000:00010000:1.0:1788658505.844413:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1788658505.844418:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658505.844429:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.844468:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.844480:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678600, rc 0) 00000100:00100000:1.0:1788658505.844546:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+11:2351:x1875544076545920:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 233us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658505.844554:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:3.0:1788658505.849429:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.849490:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076546176 00000100:00100000:0.0:1788658505.849501:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076546176 00000100:00100000:0.0:1788658505.849565:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 226 00000100:00100000:0.0:1788658505.849576:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+66:11638:x1875544076546176:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658505.849708:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+66:11638:x1875544076546176:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 132us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.849731:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 226 00000100:00100000:3.0:1788658505.851649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.851748:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076546304 00000100:00100000:2.0:1788658505.851758:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076546304 00000100:00100000:2.0:1788658505.851859:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:2.0:1788658505.851870:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+11:11638:x1875544076546304:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658505.851889:0:10289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.851908:0:10289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0f1 expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.851937:0:10289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.851946:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658505.851950:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658505.851955:0:10289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 12 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.852007:0:10289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.852020:0:10289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 12 pid: 6687 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.852034:0:10289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10289:1875544103792256:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658505.852122:0:10289:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658505.861794:0:10289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10289:1875544103792256:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658505.861840:0:10289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 12 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.861868:0:10289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a800, rc 0) 00000100:00100000:2.0:1788658505.861937:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:11638:x1875544076546304:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 10068us (10299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.861953:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:0.0:1788658505.865954:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658505.866062:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076546432 00000100:00100000:2.0:1788658505.866073:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076546432 00010000:00010000:2.0:1788658505.866115:0:7635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 12 pid: 6687 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.866159:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:2.0:1788658505.866170:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:2352:x1875544076546432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658505.866203:0:7635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658505.866234:0:7635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 12 pid: 6687 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.866249:0:7635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 12 pid: 6687 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.866276:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d92169/0xf657f176650eb9da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ea expref: 12 pid: 6687 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.866294:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788658505.866298:0:7635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658505.866305:0:7635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 11 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.866315:0:7635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 11 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.866355:0:7635:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 11 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.866381:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7635:1875544103792384:192.168.202.3@tcp:105: 00000100:00100000:2.0:1788658505.866476:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c886df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658505.875904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.875988:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076546560 00000100:00100000:0.0:1788658505.875999:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076546560 00002000:00100000:0.0:1788658505.876048:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e56ff74d880 x1875544076546560/t0(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:96/0 lens 504/0 e 0 to 0 dl 1788658516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658505.876060:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56ff74d880 with x1875544076546560 ext(0->12) 00002000:00010000:0.0:1788658505.876066:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56ff74d880 00000100:00100000:0.0:1788658505.876098:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658505.876108:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+12:2351:x1875544076546560:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788658505.876853:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2351:x1875544076546560:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 743us (957us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788658505.876863:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00002000:00100000:0.0:1788658505.876871:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e56ff74d880 x1875544076546560/t4294967320(0) o4->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:96/0 lens 504/448 e 0 to 0 dl 1788658516 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658505.876880:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56ff74d880 with x1875544076546560 ext(0->12) 00002000:00010000:0.0:1788658505.876885:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56ff74d880 00000100:00100000:2.0:1788658505.877033:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700fa2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7635:1875544103792384:192.168.202.3@tcp:105: 00010000:00010000:2.0:1788658505.877056:0:7635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658505.877091:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2352:x1875544076546432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10924us (11147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.877101:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:0.0:1788658505.879705:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.879874:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076546688 00000100:00100000:3.0:1788658505.879885:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076546688 00000100:00100000:3.0:1788658505.879946:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 227 00000100:00100000:3.0:1788658505.879957:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+66:11638:x1875544076546688:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788658505.931811:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000001:00080000:2.0:1788658505.931974:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:2.0:1788658505.931994:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:2.0:1788658505.932007:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56efab3480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788658505.932012:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56c2ad4900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56efab3d80 00000020:00080000:2.0:1788658505.932016:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56c2ad4e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e56e5b6c800 00000020:00080000:3.0:1788658505.932054:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:2.0:1788658505.932107:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788658505.932306:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+44:11638:x1875544076546688:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 52346us (52647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.932317:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 227 00000100:00100000:1.0:1788658505.933270:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658505.933290:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103792512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788658505.933348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658505.933512:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103792512 00000100:00100000:3.0:1788658505.933533:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103792512 00000100:00100000:3.0:1788658505.933583:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788658505.933592:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103792512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788658505.933619:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788658505.933651:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cc348, atime: 0x6a9cc348, ctime: 0x6a9cc348, blocks: 0x1 00010000:00010000:3.0:1788658505.933658:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.933814:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1788658505.933819:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658505.933826:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.933844:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.933855:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.933863:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.933880:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658505.934291:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658505.934299:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.934307:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658505.934312:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.934321:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.934338:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.934346:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650eb9e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658505.934381:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658505.934384:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658505.934385:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788658505.934900:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788658505.934945:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56c92ba540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788658505.934950:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff759200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56c95f1c00 00000020:00080000:2.0:1788658505.934953:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56ff759500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e56c324dc00 00000020:00080000:2.0:1788658505.934974:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1788658505.935369:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1875544103792512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1766us (2008us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788658505.935380:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:00080000:3.0:1788658505.935408:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788658505.935552:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:2.0:1788658505.935723:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e56ff74e300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788658505.935731:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103792512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788658505.936024:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658505.936036:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103792640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788658505.936078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658505.936291:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103792640 00000100:00100000:0.0:1788658505.936298:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103792640 00000100:00100000:0.0:1788658505.936349:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788658505.936377:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103792640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788658505.936403:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788658505.936427:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.936456:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.936466:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788658505.936470:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658505.936475:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.936504:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.936519:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 12 pid: 6685 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.936530:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103792768:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658505.936589:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d54b8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658505.937868:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.938081:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076546816 00000100:00100000:3.0:1788658505.938088:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076546816 00000100:00100000:3.0:1788658505.938134:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:3.0:1788658505.938299:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2352:x1875544076546816:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788658505.943625:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103792768:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658505.943654:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658505.956946:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658505.959414:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076546944 00000100:00100000:3.0:1788658505.959430:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076546944 00010000:00010000:3.0:1788658505.959472:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 14 pid: 6685 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658505.959510:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:3.0:1788658505.959520:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+14:2351:x1875544076546944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658505.959534:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658505.959540:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 14 pid: 6685 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959555:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 14 pid: 6685 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959578:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7bdfc6d/0xf657f176650eb7aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b050 expref: 14 pid: 6685 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959594:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658505.959608:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658505.959615:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959625:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959653:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658505.959752:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+13:2351:x1875544076546944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 233us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658505.959760:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00010000:00010000:3.0:1788658505.959789:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959798:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959809:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959817:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.959834:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658505.962152:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103792640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25770us (26066us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788658505.962165:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788658505.962634:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e56ff647100/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788658505.962657:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103792640:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788658505.963470:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658505.963480:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.963493:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658505.963497:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.963508:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.963527:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.963535:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650eb9ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658505.963556:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658505.963558:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658505.963560:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788658505.989842:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788658505.989878:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1788658505.990128:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076546816:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 51829us (52260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.990159:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:2.0:1788658505.997637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658505.997834:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076547200 00000100:00100000:0.0:1788658505.997845:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076547200 00000100:00100000:0.0:1788658505.997908:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 228 00000100:00100000:0.0:1788658505.997919:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:11638:x1875544076547200:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788658505.997972:0:11367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658505.998002:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ae00/0xf657f176650eb9d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0e3 expref: 20 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.998021:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:0.0:1788658505.998027:0:11367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658505.998058:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.998072:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658505.998083:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658505.998455:0:11367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7d4b4e2 reply state 00000000749b41a6 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658505.998466:0:11367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658505.998610:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:11638:x1875544076547200:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 692us (982us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788658505.998618:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 228 00010000:00010000:2.0:1788658506.003821:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.003842:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.003851:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.003857:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658506.003862:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.003871:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.003888:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:2.0:1788658506.003892:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658506.003898:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.003905:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eb9f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658506.004851:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658506.004917:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076547328 00000100:00100000:0.0:1788658506.004938:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076547328 00000100:00100000:0.0:1788658506.004991:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:0.0:1788658506.004999:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2352:x1875544076547328:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788658506.005180:0:10289:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788658506.005184:0:10289:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788658504 00002000:00010000:0.0:1788658506.005186:0:10289:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788658504 00002000:00010000:0.0:1788658506.005188:0:10289:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788658505 -> 1788658504 00002000:00010000:0.0:1788658506.005201:0:10289:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788658506.005253:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2352:x1875544076547328:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 255us (408us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788658506.005259:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00080000:1.0:1788658506.005315:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658506.013324:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658506.013461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076547584 00000100:00100000:2.0:1788658506.013471:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076547584 00000100:00100000:2.0:1788658506.013581:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 229 00000100:00100000:2.0:1788658506.013591:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:11638:x1875544076547584:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788658506.013707:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.013756:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 20 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.013765:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.013803:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 20 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.013818:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 20 pid: 11367 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658506.013833:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700538e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103792896:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658506.013919:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658506.017474:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700538e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103792896:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658506.017504:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788658506.017802:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658506.018595:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658506.018704:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076547712 00000100:00100000:3.0:1788658506.018713:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076547712 00010000:00010000:3.0:1788658506.018768:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 21 pid: 11367 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658506.018838:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:3.0:1788658506.018850:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:2351:x1875544076547712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658506.018866:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658506.018874:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 21 pid: 11367 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.018888:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 21 pid: 11367 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.018911:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a000/0xf657f176650eb9b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0d5 expref: 21 pid: 11367 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.018928:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:3.0:1788658506.018934:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.018943:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.018950:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.018977:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658506.019137:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019146:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019175:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019192:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019199:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019204:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658506.019208:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019215:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019225:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:1.0:1788658506.019234:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788658506.019238:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.019244:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650eb9fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658506.019283:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:11638:x1875544076547584:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 5693us (5968us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788658506.019292:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 229 00000100:00100000:3.0:1788658506.019515:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:2351:x1875544076547712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 666us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658506.019522:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:2.0:1788658506.023102:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658506.023335:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076547840 00000100:00100000:3.0:1788658506.023368:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076547840 00000100:00100000:3.0:1788658506.023458:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:3.0:1788658506.023469:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2353:x1875544076547840:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788658506.023510:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.023529:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 8 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.023538:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658506.023542:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658506.023548:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.023582:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 8 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.023597:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 8 pid: 10289 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658506.023613:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff74dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103793024:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658506.023896:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f454e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658506.027528:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658506.027605:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076547968 00000100:00100000:1.0:1788658506.027615:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076547968 00010000:00010000:1.0:1788658506.027660:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 9 pid: 10289 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658506.027726:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:1.0:1788658506.027736:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2352:x1875544076547968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658506.027749:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658506.027768:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 9 pid: 10289 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.027782:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 9 pid: 10289 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.027806:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658506.027810:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658506.027816:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.027842:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.027862:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658506.027901:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+9:2352:x1875544076547968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 167us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658506.027908:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00010000:00010000:2.0:1788658506.028147:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650eb9e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f1 expref: 8 pid: 10289 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658506.028164:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff74dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1875544103793024:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658506.028292:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028305:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028312:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028343:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028362:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028371:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028378:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658506.028382:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028391:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028403:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.028410:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650eba04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658506.028471:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076547840:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 5004us (5377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658506.028479:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:3.0:1788658506.030920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658506.031285:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076548224 00000100:00100000:0.0:1788658506.031294:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076548224 00000100:00100000:0.0:1788658506.031347:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 230 00000100:00100000:0.0:1788658506.031369:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:11638:x1875544076548224:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788658506.031450:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.031469:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.031484:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.031904:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.031920:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.031949:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.031989:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.032004:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 20 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658506.032019:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103793152:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658506.032136:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658506.035609:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658506.036150:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076548352 00000100:00100000:3.0:1788658506.036162:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076548352 00010000:00010000:3.0:1788658506.036283:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 21 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658506.036358:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:3.0:1788658506.036369:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56cad4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:2351:x1875544076548352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658506.036383:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658506.036390:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 21 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.036405:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 21 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.036427:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:3.0:1788658506.036433:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.036442:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.036449:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.036469:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658506.036525:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56cad4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:2351:x1875544076548352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 158us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658506.036532:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00010000:00010000:0.0:1788658506.037421:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eb9c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0dc expref: 20 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658506.037438:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103793152:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658506.037459:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.037469:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.037475:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658506.037696:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788658506.038173:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788658506.039277:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788658506.039432:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103793280:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788658506.039498:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658506.040056:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658506.040332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103793280 00000100:00100000:3.0:1788658506.040343:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103793280 00000100:00100000:3.0:1788658506.041386:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658506.041398:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6710:x1875544103793280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788658506.041688:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6710:x1875544103793280:12345-0@lo:1000:mdt00_003.0 Request processed in 292us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658506.041696:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788658506.041919:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658506.042328:0:6710:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788658506.042336:0:6710:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1788658506.042376:0:6710:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e56ff647100 x1875544103792640/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788658521 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658506.042390:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103793280:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788658506.043962:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788658506.044134:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c1301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103793408:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788658506.044385:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658506.044473:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658506.044518:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103793408 00000100:00100000:0.0:1788658506.044527:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103793408 00000100:00100000:0.0:1788658506.044619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658506.044629:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c1300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6710:x1875544103793408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788658506.044883:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c1300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6710:x1875544103793408:12345-0@lo:1000:mdt00_003.0 Request processed in 255us (498us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788658506.044893:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658506.044991:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c1301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1875544103793408:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788658506.045041:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045054:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045062:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045078:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658506.045083:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045091:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045109:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579c600) 00010000:00010000:1.0:1788658506.045112:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788658506.045117:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045133:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045167:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045174:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045596:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045602:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658506.045606:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045613:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045634:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:1.0:1788658506.045636:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788658506.045644:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045657:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045695:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.045739:0:6710:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658506.045753:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56faeb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103793536:192.168.202.3@tcp:105: 00000100:00100000:1.0:1788658506.045828:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e57008dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658506.050981:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658506.051086:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076548480 00000100:00100000:2.0:1788658506.051095:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076548480 00000100:00100000:2.0:1788658506.051164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1788658506.051174:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11637:x1875544076548480:12345-192.168.202.3@tcp:49:lfs.0 00000100:00100000:2.0:1788658506.051549:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+24:11637:x1875544076548480:12345-192.168.202.3@tcp:49:lfs.0 Request processed in 376us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658506.051557:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:0.0:1788658506.051819:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56faeb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1875544103793536:192.168.202.3@tcp:105: 00010000:00010000:0.0:1788658506.051853:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051864:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eb955 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051895:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051910:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051921:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051931:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051937:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051956:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051962:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658506.051966:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051974:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051986:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658506.051989:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658506.051993:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.051999:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650eba19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.052009:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.052016:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.052033:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.052039:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658506.052042:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.052059:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.052068:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658506.052070:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658506.052073:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658506.052079:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650eba0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658506.052458:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:11638:x1875544076548224:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 21090us (21545us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1788658506.052468:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 230 00000020:00080000:0.0:1788658506.052472:0:6710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788658506.052619:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658506.052624:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658506.052952:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788658506.052958:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658506.057579:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658506.057984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076548736 00000100:00100000:2.0:1788658506.057996:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076548736 00000100:00100000:2.0:1788658506.058067:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:2.0:1788658506.058077:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+23:11638:x1875544076548736:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788658506.059995:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788658506.060376:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1788658506.060456:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.060476:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.060488:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.060497:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.062355:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.062371:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658506.062480:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788658506.062622:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+25:11638:x1875544076548736:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 4541us (5048us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788658506.062632:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000020:00080000:2.0:1788658506.062638:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788658506.070871:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658506.070887:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.070899:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658506.070903:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.070914:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.070933:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e56d579cf00) 00010000:00010000:3.0:1788658506.070936:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788658506.070942:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.070948:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.070971:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658506.070973:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658506.070975:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658506.071392:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658506.071554:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076548992 00000100:00100000:0.0:1788658506.071565:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076548992 00000100:00100000:0.0:1788658506.071687:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 231 00000100:00100000:0.0:1788658506.071699:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+25:11637:x1875544076548992:12345-192.168.202.3@tcp:58:lfs.0 00000040:00080000:0.0:1788658506.071953:0:11367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788658506.072061:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570079c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+25:11637:x1875544076548992:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 363us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658506.072070:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 231 00000100:00100000:1.0:1788658506.108177:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658506.108311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076549120 00000100:00100000:3.0:1788658506.108321:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076549120 00000100:00100000:3.0:1788658506.108389:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 232 00000100:00100000:3.0:1788658506.108399:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+25:11641:x1875544076549120:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658506.108421:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658506.108453:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eba27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0f8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108527:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108542:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108553:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108569:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108576:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108582:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108851:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108862:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108870:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108901:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658506.108928:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 26 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658506.108941:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff74f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103793664:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658506.109038:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f454ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658506.111570:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658506.111685:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076549376 00000100:00100000:2.0:1788658506.111694:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076549376 00000100:00100000:2.0:1788658506.111756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:2.0:1788658506.111768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:5590:x1875544076549376:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788658506.111997:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:5590:x1875544076549376:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 230us (434us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788658506.112004:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:3.0:1788658506.112306:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff74f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875544103793664:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658506.112330:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658506.114359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658506.114451:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076549504 00000100:00100000:1.0:1788658506.114460:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076549504 00010000:00010000:1.0:1788658506.114498:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 28 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658506.114572:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:1.0:1788658506.114582:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:2351:x1875544076549504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658506.114596:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658506.114603:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 28 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.114615:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 28 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.114637:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79e00/0xf657f176650eb947 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0b9 expref: 28 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.114662:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:1.0:1788658506.114814:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.114824:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.114831:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.114858:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658506.114905:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:2351:x1875544076549504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 325us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658506.114912:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 87 00010000:00010000:1.0:1788658506.115025:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115039:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658506.115082:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788658506.115087:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658506.115106:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115116:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115125:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115131:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115137:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115144:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658506.115148:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115155:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115163:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:1.0:1788658506.115166:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658506.115170:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115921:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee400/0xf657f176650eba2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115937:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115943:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115949:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115954:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658506.115958:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115965:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115976:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e56d0810100) 00010000:00010000:1.0:1788658506.115979:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658506.115982:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.115988:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef600/0xf657f176650eba35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.116026:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee800/0xf657f176650eba27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f8 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.116039:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f8 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658506.116053:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:1.0:1788658506.116055:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658506.116058:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eec00, rc 0) 00000100:00100000:1.0:1788658506.116110:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11641:x1875544076549120:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7712us (7943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658506.116118:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 232 00010000:00010000:1.0:1788658506.527155:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658506.946057:0:12562:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658506.946243:0:12562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658506.946500:0:12562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788658506.946508:0:12562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788658507.100929:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658507.100938:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788658507.100988:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788658507.101003:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788658507.101122:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff74f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103793792:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788658507.101220:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f454e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658507.106091:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff74f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875544103793792:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788658507.112175:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658507.112387:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076549632 00000100:00100000:2.0:1788658507.112397:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076549632 00000100:00100000:2.0:1788658507.112459:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:2.0:1788658507.112470:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11653:x1875544076549632:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658507.112504:0:6710:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658507.112620:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11653:x1875544076549632:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 152us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658507.112628:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:1.0:1788658507.117901:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658507.118020:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076549888 00000100:00100000:2.0:1788658507.118030:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076549888 00000100:00100000:2.0:1788658507.118115:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 234 00000100:00100000:2.0:1788658507.118133:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+26:11653:x1875544076549888:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658507.118156:0:11367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658507.118177:0:11367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eba43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b0ff expref: -99 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658507.118269:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eba4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658507.118283:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eba4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658507.118297:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eba4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658507.118308:0:11367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788658507.118449:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891be00/0xf657f176650eba43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ff expref: 29 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658507.118468:0:11367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eba4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ff expref: 28 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658507.118476:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658507.118478:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658507.118482:0:11367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a800, rc 0) 00000100:00100000:2.0:1788658507.118542:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:11653:x1875544076549888:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 411us (650us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788658507.118549:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 234 00000100:00100000:3.0:1788658507.120800:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658507.120844:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076550016 00000100:00100000:1.0:1788658507.120853:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076550016 00000100:00100000:1.0:1788658507.120992:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:1.0:1788658507.121003:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:2352:x1875544076550016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658507.121017:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658507.121040:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a800/0xf657f176650eba4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0ff expref: 28 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658507.121055:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:1.0:1788658507.121060:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658507.121106:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:2352:x1875544076550016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658507.121113:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:1.0:1788658507.123846:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658507.123936:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076550272 00000100:00100000:3.0:1788658507.123945:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076550272 00000100:00100000:3.0:1788658507.124003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 235 00000100:00100000:3.0:1788658507.124012:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+27:11653:x1875544076550272:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788658507.124091:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124117:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124129:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124306:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124313:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124321:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124326:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658507.124331:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124338:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124350:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:3.0:1788658507.124499:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658507.124505:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658507.124512:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ee000/0xf657f176650eba58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658507.124726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:11653:x1875544076550272:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 712us (886us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788658507.124740:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 235 00000040:00080000:1.0:1788658507.129136:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658507.129147:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658507.130038:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788658507.130057:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788658507.134019:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658507.140078:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076550528 00000100:00100000:0.0:1788658507.140110:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076550528 00000100:00100000:0.0:1788658507.140181:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:0.0:1788658507.140192:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+28:11653:x1875544076550528:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788658507.140456:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:11653:x1875544076550528:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 264us (6447us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788658507.140464:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00000001:00080000:3.0:1788658507.218494:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788658507.218511:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788658507.218518:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:3.0:1788658507.551978:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658508.584346:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658508.955388:0:12615:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658508.955397:0:12615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658508.955452:0:12615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788658508.955457:0:12615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788658509.161499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658509.161713:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076550784 00000100:00100000:0.0:1788658509.161724:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076550784 00000100:00100000:0.0:1788658509.161805:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 236 00000100:00100000:0.0:1788658509.161817:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+29:11673:x1875544076550784:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658509.161840:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658509.161861:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eba5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b106 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658509.161959:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658509.161973:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658509.161988:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658509.161998:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788658509.162116:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79a00/0xf657f176650eba5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b106 expref: 32 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658509.162133:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b106 expref: 31 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658509.162155:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658509.162158:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788658509.162162:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79800, rc 0) 00000100:00100000:0.0:1788658509.162223:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:11673:x1875544076550784:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 409us (742us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788658509.162230:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 236 00000100:00080000:1.0:1788658509.162373:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658509.169121:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658509.169200:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076550912 00000100:00100000:1.0:1788658509.169211:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076550912 00000100:00100000:1.0:1788658509.169277:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 237 00000100:00100000:1.0:1788658509.169287:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:11673:x1875544076550912:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:1.0:1788658509.169352:0:11367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169369:0:11367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169380:0:11367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169407:0:11367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169414:0:11367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169421:0:11367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169427:0:11367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679a00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658509.169433:0:11367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169441:0:11367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169469:0:11367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:1.0:1788658509.169472:0:11367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658509.169478:0:11367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658509.169485:0:11367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679a00/0xf657f176650eba74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658509.169569:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:11673:x1875544076550912:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 274us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658509.169578:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 237 00000100:00100000:3.0:1788658509.267736:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658509.267837:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076551040 00000100:00100000:0.0:1788658509.267846:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076551040 00000100:00100000:0.0:1788658509.267923:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:0.0:1788658509.267935:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076551040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1788658509.267953:0:10289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658509.267976:0:10289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650eba7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b10d expref: -99 pid: 10289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658509.268004:0:10289:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9cc348, atime: 0x6a9cc348, ctime: 0x6a9cc348, blocks: 0xb 00010000:00010000:0.0:1788658509.268023:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1788658509.268028:0:10289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658509.268036:0:10289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650eba7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b10d expref: 8 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658509.268054:0:10289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650eba7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b10d expref: 8 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658509.268066:0:10289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658509.268139:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2353:x1875544076551040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 207us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658509.268146:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00080000:1.0:1788658509.268272:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658509.277983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658509.278430:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076551168 00000100:00100000:1.0:1788658509.278449:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076551168 00002000:00100000:1.0:1788658509.278518:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e56ff74f100 x1875544076551168/t0(0) o3->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:100/0 lens 488/0 e 0 to 0 dl 1788658520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658509.278531:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56ff74f100 with x1875544076551168 ext(0->4095) 00002000:00010000:1.0:1788658509.278537:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56ff74f100 00000100:00100000:1.0:1788658509.278569:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658509.278579:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2354:x1875544076551168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1788658509.283460:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+8:2354:x1875544076551168:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4872us (5477us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788658509.283478:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00002000:00100000:2.0:1788658509.283510:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e56ff74f100 x1875544076551168/t0(0) o3->df8d83e3-27bc-4e5d-ab80-c17af5c0fb38@192.168.202.3@tcp:100/0 lens 488/4536 e 0 to 0 dl 1788658520 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658509.283521:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e56ff74f100 with x1875544076551168 ext(0->4095) 00002000:00010000:2.0:1788658509.283527:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e56ff74f100 00010000:00010000:1.0:1788658509.596825:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788658509.724980:0:6734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400864312198ns, next at 401864308663ns, rc = 0 00000100:00100000:2.0:1788658509.725123:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658509.725151:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103793920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658509.725229:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658509.725368:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103793920 00000100:00100000:1.0:1788658509.725376:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103793920 00000100:00100000:1.0:1788658509.725443:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788658509.725453:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875544103793920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658509.725503:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658509.725550:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875544103793920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658509.725557:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788658509.725606:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103793920:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788658509.725787:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658510.014465:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658510.014521:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658510.014552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658510.014580:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658510.014609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076551424 00000100:00100000:3.0:1788658510.014618:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076551424 00000100:00100000:3.0:1788658510.014701:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076551680 00000100:00100000:3.0:1788658510.014705:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076551680 00000100:00100000:3.0:1788658510.014739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 154 00000100:00100000:3.0:1788658510.014749:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:2351:x1875544076551424:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658510.014825:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+31:2351:x1875544076551424:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658510.014833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 154 00000100:00100000:3.0:1788658510.014851:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 155 00000100:00100000:3.0:1788658510.014858:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076551680:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658510.014883:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:2351:x1875544076551680:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658510.014919:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 155 00000100:00080000:3.0:1788658510.014945:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658510.015201:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076551296 00000100:00100000:1.0:1788658510.015207:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076551296 00000100:00100000:1.0:1788658510.015249:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 297 00000100:00100000:1.0:1788658510.015257:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076551296:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658510.015294:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c5628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076551296:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 38us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658510.015300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 297 00000100:00100000:0.0:1788658510.015619:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076551552 00000100:00100000:0.0:1788658510.015625:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076551552 00000100:00100000:0.0:1788658510.015711:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:0.0:1788658510.015719:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076551552:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658510.015760:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076551552:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 42us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658510.015766:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00080000:1.0:1788658510.015851:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658510.237058:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103794048:0@lo:400:kworker.0 00000100:00100000:1.0:1788658510.237127:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658510.237240:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794048 00000100:00100000:0.0:1788658510.237248:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794048 00000100:00100000:0.0:1788658510.237292:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788658510.237302:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103794048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658510.237331:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658510.237340:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103794176:0@lo:400:kworker.0 00000100:00100000:0.0:1788658510.237358:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3306:x1875544103794048:12345-0@lo:400:kworker.0 Request processed in 56us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658510.237366:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788658510.237390:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658510.237426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794176 00000100:00100000:0.0:1788658510.237430:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794176 00000100:00100000:0.0:1788658510.237471:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788658510.237476:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103794176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658510.237509:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103794176:12345-0@lo:400:kworker.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658510.237516:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788658510.237565:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88ab4306-42c5-43ae-b202-256d86278024:3306:1875544103794048:0@lo:400:kworker.0 00000100:00100000:1.0:1788658510.237594:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103794176:0@lo:400:kworker.0 00000100:00100000:2.0:1788658510.238950:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103794432:0@lo:400:kworker.0 00000100:00100000:2.0:1788658510.239014:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658510.239041:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658510.239046:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56de9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103794304:0@lo:400:kworker.0 00000100:00100000:2.0:1788658510.239067:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658510.239090:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794432 00000100:00100000:2.0:1788658510.239095:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794432 00000100:00100000:2.0:1788658510.239127:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788658510.239134:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103794432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658510.239171:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103794432:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658510.239178:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788658510.239235:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103794688:0@lo:400:kworker.0 00000100:00100000:0.0:1788658510.239267:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658510.239271:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794304 00000100:00100000:2.0:1788658510.239285:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794304 00000100:00100000:0.0:1788658510.239298:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658510.239306:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103794560:0@lo:400:kworker.0 00000100:00100000:0.0:1788658510.239329:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658510.239356:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794688 00000100:00100000:0.0:1788658510.239361:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794688 00000100:00100000:2.0:1788658510.239394:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794560 00000100:00100000:2.0:1788658510.239399:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794560 00000100:00100000:0.0:1788658510.239401:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788658510.239411:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658510.239462:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788658510.239466:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103794688:12345-0@lo:400:kworker.0 Request processed in 54us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658510.239474:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103794304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658510.239477:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788658510.239556:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658510.239561:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658510.239604:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788658510.239615:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103794560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658510.240268:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788658510.240278:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e56faebb480, transno 4294967307 00000004:00080000:0.0:1788658510.240292:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788658510.240314:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e56ff74e300, transno 4294967310 00000100:00100000:0.0:1788658510.240322:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103794688:0@lo:400:kworker.0 00000100:00100000:2.0:1788658510.240596:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103794304:12345-0@lo:400:kworker.0 Request processed in 1123us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658510.240605:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788658510.240642:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56de9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103794304:0@lo:400:kworker.0 00000100:00100000:2.0:1788658510.240653:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103794432:0@lo:400:kworker.0 00000100:00100000:1.0:1788658510.241170:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103794560:12345-0@lo:400:kworker.0 Request processed in 1556us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658510.241179:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788658510.241420:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103794560:0@lo:400:kworker.0 00010000:00010000:3.0:1788658510.622284:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658510.753422:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103794816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658510.753516:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658510.753623:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794816 00000100:00100000:1.0:1788658510.753631:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794816 00000100:00100000:1.0:1788658510.753698:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658510.753707:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103794816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658510.753747:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658510.753796:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103794816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658510.753804:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658510.753855:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103794816:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788658511.315443:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788658511.315462:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788658511.326332:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00080000:2.0:1788658511.326361:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788658511.326386:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56d54b8cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788658511.326392:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56d1d9a900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56cb171240 00000020:00080000:2.0:1788658511.326395:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56d1d9a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e56c324dc00 00000020:00080000:2.0:1788658511.326431:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788658511.326473:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788658511.326725:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788658511.326961:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103794944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788658511.327037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658511.327180:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103794944 00000100:00100000:1.0:1788658511.327188:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103794944 00000100:00100000:1.0:1788658511.327268:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658511.327279:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103794944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788658511.327490:0:10289:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788658511.327495:0:10289:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788658504 -> 1788658504 00002000:00010000:1.0:1788658511.327498:0:10289:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788658504 -> 1788658504 00002000:00010000:1.0:1788658511.327500:0:10289:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788658504 -> 1788658504 00002000:00010000:1.0:1788658511.327502:0:10289:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00080000:0.0:1788658511.327622:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658511.327980:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103794944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 701us (942us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788658511.328002:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658511.328053:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1788658511.328058:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e56ff647100, transno 4294967321 00000004:00080000:1.0:1788658511.328078:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1788658511.328102:0:3305:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e570056a680 x1875544103794944/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788658527 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788658511.328113:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e570056a680/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788658511.328118:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103794944:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788658511.650051:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658512.669169:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658513.693321:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658514.405038:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658514.406892:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076551808 00000100:00100000:0.0:1788658514.406910:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076551808 00000100:00100000:0.0:1788658514.407023:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 238 00000100:00100000:0.0:1788658514.407035:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11318:x1875544076551808:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788658514.407188:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11318:x1875544076551808:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 Request processed in 156us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658514.407196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 238 00000100:00080000:1.0:1788658514.407964:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658514.423324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658514.423551:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552064 00000100:00100000:2.0:1788658514.423566:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552064 00000100:00100000:2.0:1788658514.423686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:2.0:1788658514.423700:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:11318:x1875544076552064:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658514.424533:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:11318:x1875544076552064:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 829us (1219us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788658514.424568:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00010000:00010000:2.0:1788658514.717271:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658514.839373:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658514.839719:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552192 00000100:00100000:2.0:1788658514.839735:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552192 00000100:00100000:2.0:1788658514.839834:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 239 00000100:00080000:1.0:1788658514.839838:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658514.839848:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+5:12124:x1875544076552192:12345-192.168.202.3@tcp:101:lsof.0 00010000:00010000:2.0:1788658514.839876:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658514.839900:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eba82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b114 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658514.839964:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658514.839978:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658514.840238:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658514.840276:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658514.840280:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658514.840305:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658514.840331:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650eba82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b114 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658514.840366:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b114 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658514.840395:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:2.0:1788658514.840398:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658514.840402:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b600, rc 0) 00000100:00100000:2.0:1788658514.840474:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:12124:x1875544076552192:12345-192.168.202.3@tcp:101:lsof.0 Request processed in 629us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658514.840481:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 239 00000100:00100000:0.0:1788658514.848097:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658514.848134:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103795072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658514.848210:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658514.849460:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795072 00000100:00100000:1.0:1788658514.849473:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795072 00000100:00100000:1.0:1788658514.849559:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788658514.849581:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103795072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658514.849621:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658514.849735:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103795072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658514.849744:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788658514.850149:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658514.850170:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103795072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658515.116478:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658515.116527:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658515.116738:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552320 00000100:00100000:2.0:1788658515.116749:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552320 00000100:00100000:2.0:1788658515.116824:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 299 00000100:00100000:2.0:1788658515.116834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076552320:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658515.116911:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2353:x1875544076552320:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 78us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658515.116919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 299 00000100:00100000:0.0:1788658515.117114:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552576 00000100:00100000:0.0:1788658515.117119:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552576 00000100:00100000:0.0:1788658515.117167:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:0.0:1788658515.117175:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2353:x1875544076552576:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658515.117204:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2353:x1875544076552576:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658515.117210:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:3.0:1788658515.117402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658515.117696:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552448 00000100:00100000:1.0:1788658515.117705:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552448 00000100:00100000:1.0:1788658515.117747:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:1.0:1788658515.117756:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570104e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076552448:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658515.117797:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570104e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2353:x1875544076552448:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 43us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658515.117814:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00080000:2.0:1788658515.118830:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658515.118838:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658515.356929:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103795456:0@lo:400:kworker.0 00000100:00100000:2.0:1788658515.356948:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103795328:0@lo:400:kworker.0 00000100:00100000:0.0:1788658515.357073:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103795200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658515.357163:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103795584:0@lo:400:kworker.0 00000100:00100000:2.0:1788658515.366078:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658515.366327:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103795840:0@lo:400:kworker.0 00000100:00100000:3.0:1788658515.366343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658515.366512:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795328 00000100:00100000:3.0:1788658515.366524:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795328 00000100:00100000:3.0:1788658515.366586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795456 00000100:00100000:3.0:1788658515.366589:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795456 00000100:00100000:3.0:1788658515.366627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788658515.366642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103795328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658515.366744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103795328:12345-0@lo:400:kworker.0 Request processed in 107us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658515.366752:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788658515.366784:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788658515.366792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103795456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658515.366811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658515.366836:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103795456:12345-0@lo:400:kworker.0 Request processed in 43us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658515.366862:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788658515.366914:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103795456:0@lo:400:kworker.0 00000100:00080000:3.0:1788658515.366958:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658515.366984:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795840 00000100:00100000:3.0:1788658515.366989:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795840 00000100:00100000:3.0:1788658515.367023:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788658515.367126:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103795328:0@lo:400:kworker.0 00000100:00080000:2.0:1788658515.367412:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658515.367810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658515.367849:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103795712:0@lo:400:kworker.0 00000100:00100000:0.0:1788658515.367884:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658515.367917:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795712 00000100:00100000:0.0:1788658515.367922:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795712 00000100:00100000:0.0:1788658515.367975:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788658515.367984:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103795712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658515.368033:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103795712:12345-0@lo:400:kworker.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658515.368041:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788658515.368060:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658515.368096:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103795712:0@lo:400:kworker.0 00000100:00100000:2.0:1788658515.368252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795200 00000100:00100000:2.0:1788658515.368256:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795200 00000100:00100000:3.0:1788658515.369333:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103795840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658515.369451:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103795840:12345-0@lo:400:kworker.0 Request processed in 2421us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658515.369464:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788658515.369627:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103795840:0@lo:400:kworker.0 00000100:00100000:2.0:1788658515.371800:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788658515.371822:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103795200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658515.371937:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103795200:12345-0@lo:400:kworker.0 Request processed in 126us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658515.371945:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788658515.372092:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658515.372246:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795584 00000100:00100000:2.0:1788658515.372255:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795584 00000100:00100000:2.0:1788658515.372312:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788658515.372319:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103795584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658515.372355:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103795584:12345-0@lo:400:kworker.0 Request processed in 37us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658515.372361:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658515.372888:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103795200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658515.373076:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103795584:0@lo:400:kworker.0 00010000:00010000:1.0:1788658515.740822:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658515.868947:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103795968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658515.869086:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658515.869155:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103795968 00000100:00100000:1.0:1788658515.869166:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103795968 00000100:00100000:1.0:1788658515.869250:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788658515.869257:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788658515.869268:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103795968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658515.869277:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788658515.869307:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658515.869476:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103795968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658515.869484:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788658515.874658:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103795968:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788658516.387995:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658516.388009:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658516.388346:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788658516.388353:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788658516.442529:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:2.0:1788658516.463217:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1788658516.463242:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788658516.463295:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788658516.463309:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788658516.764878:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658517.801863:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788658518.634778:0:12819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:35:16 (1788658516) 00010000:00010000:1.0:1788658518.813571:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658519.839361:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658519.968054:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103796096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658519.968128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658519.968642:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796096 00000100:00100000:0.0:1788658519.968651:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796096 00000100:00100000:0.0:1788658519.968743:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658519.968765:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103796096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658519.968804:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788658519.968948:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658519.969047:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103796096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658519.969055:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788658519.969124:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788658519.969131:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e570056a680, transno 4294967324 00000100:00100000:2.0:1788658519.969158:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103796096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658520.234435:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658520.234483:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658520.234525:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658520.234548:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658520.234569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658520.234596:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076553216 00000100:00100000:3.0:1788658520.234605:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076553216 00000100:00100000:3.0:1788658520.234703:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552832 00000100:00100000:3.0:1788658520.234707:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552832 00000100:00100000:3.0:1788658520.234733:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:3.0:1788658520.234758:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2351:x1875544076553216:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658520.234830:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2351:x1875544076553216:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658520.234837:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:3.0:1788658520.234853:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:3.0:1788658520.234859:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:2351:x1875544076552832:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658520.234890:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:2351:x1875544076552832:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658520.234895:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:3.0:1788658520.234917:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552960 00000100:00100000:3.0:1788658520.234920:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552960 00000100:00100000:3.0:1788658520.234946:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076553088 00000100:00100000:3.0:1788658520.234948:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076553088 00000100:00100000:3.0:1788658520.234966:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:3.0:1788658520.234972:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076552960:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658520.235133:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076552704 00000100:00100000:0.0:1788658520.235138:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076552704 00000100:00100000:0.0:1788658520.235169:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 301 00000100:00100000:0.0:1788658520.235177:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076552704:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658520.235204:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2351:x1875544076552704:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658520.235209:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 301 00000100:00100000:2.0:1788658520.235483:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:2.0:1788658520.235494:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076553088:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658520.235531:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2351:x1875544076553088:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 40us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658520.235537:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:3.0:1788658520.237723:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2351:x1875544076552960:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658520.237749:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00080000:3.0:1788658520.237792:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658520.237797:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658520.237800:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658520.477407:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103796352:0@lo:400:kworker.0 00000100:00100000:1.0:1788658520.477475:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658520.477491:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103796480:0@lo:400:kworker.0 00000100:00100000:3.0:1788658520.477519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658520.477542:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796352 00000100:00100000:3.0:1788658520.477548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796480 00000100:00100000:1.0:1788658520.477549:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796352 00000100:00100000:3.0:1788658520.477550:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796480 00000100:00100000:0.0:1788658520.477598:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103796224:0@lo:400:kworker.0 00000100:00100000:3.0:1788658520.477600:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788658520.477638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658520.477660:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103796736:0@lo:400:kworker.0 00000100:00100000:0.0:1788658520.477717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658520.477737:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658520.477743:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103796608:0@lo:400:kworker.0 00000100:00100000:0.0:1788658520.477764:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658520.477787:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796736 00000100:00100000:0.0:1788658520.477791:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796736 00000100:00100000:0.0:1788658520.477819:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658520.477827:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103796736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658520.477885:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103796736:12345-0@lo:400:kworker.0 Request processed in 58us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658520.477892:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658520.477913:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796608 00000100:00100000:0.0:1788658520.477916:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796608 00000100:00100000:1.0:1788658520.478684:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788658520.478695:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103796352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658520.478744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103796352:12345-0@lo:400:kworker.0 Request processed in 50us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658520.478751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788658520.478789:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103796352:0@lo:400:kworker.0 00000100:00100000:1.0:1788658520.478862:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103796736:0@lo:400:kworker.0 00000100:00080000:1.0:1788658520.478894:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658520.478907:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658520.478925:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796224 00000100:00100000:1.0:1788658520.478929:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796224 00000100:00100000:1.0:1788658520.478955:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788658520.478963:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103796224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658520.479008:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103796224:12345-0@lo:400:kworker.0 Request processed in 46us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658520.479014:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788658520.479050:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103796224:0@lo:400:kworker.0 00000100:00100000:3.0:1788658520.481296:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103796480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658520.481498:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103796480:12345-0@lo:400:kworker.0 Request processed in 3881us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658520.481508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788658520.481857:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103796480:0@lo:400:kworker.0 00000100:00100000:0.0:1788658520.484776:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788658520.484789:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103796608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658520.485223:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103796608:12345-0@lo:400:kworker.0 Request processed in 435us (7456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658520.485231:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1788658520.487010:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658520.490066:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103796608:0@lo:400:kworker.0 00010000:00010000:2.0:1788658520.860953:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658520.991680:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658520.991711:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103796864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658520.992106:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658520.992437:0:12778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796864 00000100:00100000:0.0:1788658520.992447:0:12778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796864 00000100:00100000:0.0:1788658520.992502:0:12778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788658520.992512:0:12778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103796864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658520.992547:0:12778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658520.992593:0:12778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103796864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658520.992600:0:12778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658520.993139:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103796864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788658521.886034:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658522.909236:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658523.240364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658523.241727:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076553472 00000100:00100000:2.0:1788658523.241744:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076553472 00000100:00100000:2.0:1788658523.241851:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:2.0:1788658523.241864:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+18:12346:x1875544076553472:12345-192.168.202.3@tcp:35:umount.0 00000100:00100000:2.0:1788658523.242229:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:12346:x1875544076553472:12345-192.168.202.3@tcp:35:umount.0 Request processed in 367us (1874us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788658523.242236:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00080000:1.0:1788658523.242316:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658523.245096:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658523.246190:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076553728 00000100:00100000:2.0:1788658523.246205:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076553728 00000100:00100000:2.0:1788658523.246288:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 67 00000100:00100000:2.0:1788658523.246300:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+19:12346:x1875544076553728:12345-192.168.202.3@tcp:35:umount.0 00000100:00100000:2.0:1788658523.246860:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:12346:x1875544076553728:12345-192.168.202.3@tcp:35:umount.0 Request processed in 560us (1771us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788658523.246869:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 67 00000100:00100000:3.0:1788658523.249325:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658523.249947:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076553984 00000100:00100000:2.0:1788658523.249960:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076553984 00000100:00100000:2.0:1788658523.250091:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:2.0:1788658523.250104:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c9a78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+20:12346:x1875544076553984:12345-192.168.202.3@tcp:35:umount.0 00000100:00100000:2.0:1788658523.250348:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c9a78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:12346:x1875544076553984:12345-192.168.202.3@tcp:35:umount.0 Request processed in 246us (1030us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788658523.250374:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:3.0:1788658523.253976:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658523.255447:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076554240 00000100:00100000:0.0:1788658523.255478:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076554240 00000100:00100000:0.0:1788658523.255769:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:0.0:1788658523.255780:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:12346:x1875544076554240:12345-192.168.202.3@tcp:35:umount.0 00000100:00100000:1.0:1788658523.262140:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:12346:x1875544076554240:12345-192.168.202.3@tcp:35:umount.0 Request processed in 6347us (8157us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788658523.262157:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1788658523.268624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658523.268657:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658523.268721:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658523.268834:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076554368 00000100:00100000:2.0:1788658523.268845:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076554368 00000100:00100000:2.0:1788658523.268903:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076554624 00000100:00100000:2.0:1788658523.268906:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076554624 00000100:00100000:2.0:1788658523.268916:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076554496 00000100:00100000:2.0:1788658523.268918:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076554496 00000100:00100000:2.0:1788658523.268928:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:2.0:1788658523.268934:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+15:2352:x1875544076554368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658523.268947:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658523.268963:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cd600/0xf657f176650eab01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac9f expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658523.268978:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658523.269017:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+14:2352:x1875544076554368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658523.269021:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:2.0:1788658523.269032:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1788658523.269036:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+13:2352:x1875544076554624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658523.269042:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658523.269050:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891ba00/0xf657f176650ead15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad6a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658523.269071:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658523.269089:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff01e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:2352:x1875544076554624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658523.269095:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1788658523.269122:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:2.0:1788658523.269129:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:2352:x1875544076554496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658523.269137:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658523.269145:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d9800/0xf657f176650eaa67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ac67 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658523.269154:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658523.269174:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2352:x1875544076554496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658523.269180:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:3.0:1788658523.271953:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658523.272008:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076554752 00000100:00100000:2.0:1788658523.272018:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076554752 00000100:00100000:2.0:1788658523.272096:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:2.0:1788658523.272108:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+5:2350:x1875544076554752:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:2.0:1788658523.272137:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eadd9 00000100:00080000:2.0:1788658523.272147:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9e56c6ae8800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788658523.272170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788658523.272188:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788658523.272472:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+2:2350:x1875544076554752:12345-192.168.202.3@tcp:9:umount.0 Request processed in 366us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658523.272480:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00080000:1.0:1788658523.272623:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658523.286427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658523.286642:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076555136 00000100:00100000:0.0:1788658523.286652:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076555136 00000100:00100000:0.0:1788658523.286772:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:0.0:1788658523.286784:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+7:2350:x1875544076555136:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:0.0:1788658523.286815:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eb03a 00000020:00010000:0.0:1788658523.286824:0:6687:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e56ff010000: total 0 00000100:00080000:0.0:1788658523.286828:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9e56ff016800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658523.286873:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1788658523.286915:0:8450:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e56ff010000: total 0 00010000:00010000:3.0:1788658523.286952:0:8450:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e56ff010000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788658523.287005:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650eba7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b10d expref: 6 pid: 10289 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658523.287048:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abd7854/0xf657f176650eb3dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af3f expref: 5 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658523.287072:0:8450:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e56ff010000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788658523.287085:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658523.287087:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658523.287115:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658523.287128:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658523.287382:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+2:2350:x1875544076555136:12345-192.168.202.3@tcp:9:umount.0 Request processed in 600us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658523.287390:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:3.0:1788658523.299027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658523.299464:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076556160 00000100:00100000:1.0:1788658523.299475:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076556160 00000100:00100000:1.0:1788658523.299620:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 240 00000100:00100000:1.0:1788658523.299633:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+22:2350:x1875544076556160:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:1.0:1788658523.299721:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eaa75 00000020:00010000:1.0:1788658523.299740:0:6710:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e570051b000: total 0 00000100:00080000:1.0:1788658523.299745:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9e570051a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658523.299790:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788658523.300242:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8d83e3-27bc-4e5d-ab80-c17af5c0fb38+21:2350:x1875544076556160:12345-192.168.202.3@tcp:39:umount.0 Request processed in 612us (1223us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788658523.300266:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 240 00000020:00010000:0.0:1788658523.300335:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e570051b000: total 0 00010000:00010000:0.0:1788658523.300381:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e570051b000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788658523.300414:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658523.300418:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788658523.300426:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78800/0xf657f176650eb45b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af62 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300446:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658523.300449:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658523.300453:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891bc00/0xf657f176650eb2be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aef2 expref: 19 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300466:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:0.0:1788658523.300469:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788658523.300480:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891a200/0xf657f176650eadaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad94 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300496:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658523.300499:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658523.300503:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef000/0xf657f176650eb95c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0c0 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300515:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:0.0:1788658523.300518:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658523.300521:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b400/0xf657f176650eb43f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af5b expref: 16 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300543:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69700) 00010000:00010000:0.0:1788658523.300545:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658523.300548:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78000/0xf657f176650ead5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad7f expref: 15 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300567:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658523.300569:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788658523.300573:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007ef400/0xf657f176650eb3c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af38 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300583:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658523.300585:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658523.300589:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eec00/0xf657f176650eba3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b0f8 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300600:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658523.300608:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788658523.300612:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79800/0xf657f176650eba66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b106 expref: 12 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300629:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e56d0810b00) 00010000:00010000:0.0:1788658523.300631:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658523.300634:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efc00/0xf657f176650eb39e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8af2a expref: 11 pid: 11367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300647:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e56c3c69100) 00010000:00010000:0.0:1788658523.300649:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658523.300652:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007efe00/0xf657f176650eb73a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b034 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300704:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e56d579cc00) 00010000:00010000:0.0:1788658523.300708:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658523.300712:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57007eea00/0xf657f176650eb09c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ae66 expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300726:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56d579c000) 00010000:00010000:0.0:1788658523.300728:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658523.300732:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b000/0xf657f176650ead3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad78 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658523.300743:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e570051b000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788658523.300767:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658523.300770:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658523.300771:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658523.934992:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658524.963569:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658525.086396:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103796992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658525.086488:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658525.086934:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103796992 00000100:00100000:3.0:1788658525.086956:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103796992 00000100:00100000:3.0:1788658525.087033:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788658525.087043:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103796992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658525.087081:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788658525.087158:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658525.118218:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103796992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31166us (31720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658525.118232:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788658525.119898:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103796992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658525.355580:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658525.355647:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658525.355777:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076556416 00000100:00100000:1.0:1788658525.355786:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076556416 00000100:00100000:1.0:1788658525.355849:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:1.0:1788658525.355859:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2353:x1875544076556416:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658525.355959:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2353:x1875544076556416:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 102us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658525.355969:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00080000:0.0:1788658525.357628:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658525.362540:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076556288 00000100:00100000:2.0:1788658525.362554:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076556288 00000100:00100000:2.0:1788658525.362635:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 303 00000100:00100000:2.0:1788658525.362678:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2353:x1875544076556288:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658525.362768:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2353:x1875544076556288:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 108us (7119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658525.362776:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 303 00000100:00100000:3.0:1788658525.598684:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103797248:0@lo:400:kworker.0 00000100:00100000:3.0:1788658525.598759:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658525.598829:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788658525.598835:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103797120:0@lo:400:kworker.0 00000100:00100000:3.0:1788658525.598868:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658525.598906:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103797632:0@lo:400:kworker.0 00000100:00100000:3.0:1788658525.598935:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658525.598969:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103797120 00000100:00100000:3.0:1788658525.598978:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103797120 00000100:00100000:3.0:1788658525.599023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788658525.599031:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103797120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658525.599079:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88ab4306-42c5-43ae-b202-256d86278024+19:3307:x1875544103797120:12345-0@lo:400:kworker.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658525.599104:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788658525.599140:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103797632 00000100:00100000:3.0:1788658525.599144:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103797632 00000100:00100000:3.0:1788658525.599177:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788658525.599184:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103797632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658525.599214:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103797632:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658525.599220:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788658525.599253:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103797120:0@lo:400:kworker.0 00000100:00100000:3.0:1788658525.599266:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103797632:0@lo:400:kworker.0 00000100:00100000:2.0:1788658525.599584:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103797504:0@lo:400:kworker.0 00000100:00100000:2.0:1788658525.599621:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658525.599655:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658525.599699:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103797376:0@lo:400:kworker.0 00000100:00100000:2.0:1788658525.599724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658525.599852:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103797248 00000100:00100000:1.0:1788658525.599859:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103797248 00000100:00100000:1.0:1788658525.599899:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103797504 00000100:00100000:1.0:1788658525.599903:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103797504 00000100:00100000:1.0:1788658525.599931:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103797376 00000100:00100000:1.0:1788658525.599934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103797376 00000100:00100000:1.0:1788658525.599950:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788658525.599958:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103797248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658525.599998:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103797248:12345-0@lo:400:kworker.0 Request processed in 41us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658525.600004:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788658525.600016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788658525.600022:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103797504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658525.600045:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103797504:12345-0@lo:400:kworker.0 Request processed in 24us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658525.600049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788658525.600058:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788658525.600063:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103797376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658525.600096:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103797376:12345-0@lo:400:kworker.0 Request processed in 33us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658525.600101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788658525.600264:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103797376:0@lo:400:kworker.0 00000100:00100000:2.0:1788658525.600273:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103797504:0@lo:400:kworker.0 00000100:00100000:3.0:1788658525.600573:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103797248:0@lo:400:kworker.0 00000100:00080000:0.0:1788658525.600698:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658525.600703:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658525.872134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658525.872184:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658525.872221:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658525.872343:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076556544 00000100:00100000:2.0:1788658525.872354:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076556544 00000100:00100000:2.0:1788658525.872418:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076556672 00000100:00100000:2.0:1788658525.872421:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076556672 00000100:00100000:2.0:1788658525.872434:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076556800 00000100:00100000:2.0:1788658525.872437:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076556800 00000100:00100000:2.0:1788658525.872451:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:2.0:1788658525.872460:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+12:2351:x1875544076556544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658525.872475:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658525.872493:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dee00/0xf657f176650eab47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acb4 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.872511:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658525.872570:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+11:2351:x1875544076556544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658525.872590:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:2.0:1788658525.872609:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:2.0:1788658525.872626:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56cad4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+10:2351:x1875544076556672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658525.872634:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658525.872642:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cd200/0xf657f176650eab4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8acde expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.872652:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658525.872718:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56cad4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+9:2351:x1875544076556672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 103us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658525.872725:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:2.0:1788658525.872767:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1788658525.872774:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+8:2352:x1875544076556800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658525.872782:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658525.872791:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79000/0xf657f176650ead0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8ad63 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.872801:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658525.872818:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e2ec63-51f5-4911-9a1f-c6731fda8201+7:2352:x1875544076556800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658525.872824:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:3.0:1788658525.882466:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658525.882645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076557056 00000100:00100000:1.0:1788658525.882655:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076557056 00000100:00100000:1.0:1788658525.882725:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 241 00000100:00100000:1.0:1788658525.882734:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+6:2350:x1875544076557056:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:1.0:1788658525.882769:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eab5c 00000020:00010000:1.0:1788658525.882777:0:5839:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5700519000: total 0 00000100:00080000:1.0:1788658525.882781:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9e570051b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658525.882807:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:0.0:1788658525.882965:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5700519000: total 0 00010000:00010000:0.0:1788658525.882970:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658525.883011:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5700519000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788658525.883055:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56d579c700) 00010000:00010000:0.0:1788658525.883059:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658525.883066:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650eba89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b114 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658525.883089:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5700519000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788658525.883097:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658525.883099:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658525.883101:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658525.884138:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5097b18f-92da-45ff-9ffe-4c6d955a08f5+3:2350:x1875544076557056:12345-192.168.202.3@tcp:39:umount.0 Request processed in 877us (1152us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788658525.884149:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 241 00000100:00100000:1.0:1788658525.903597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658525.903747:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076557312 00000100:00100000:3.0:1788658525.903758:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076557312 00000100:00100000:3.0:1788658525.903813:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 305 00000100:00100000:3.0:1788658525.903823:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+7:2350:x1875544076557312:12345-192.168.202.3@tcp:251:umount.0 00000020:00000080:3.0:1788658525.903874:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eaa52 00000020:00010000:3.0:1788658525.903882:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e57007bc800: total 0 00000100:00080000:3.0:1788658525.903887:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9e57007bd000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788658525.903962:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c64f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e2ec63-51f5-4911-9a1f-c6731fda8201+3:2350:x1875544076557312:12345-192.168.202.3@tcp:251:umount.0 Request processed in 140us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658525.903970:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 305 00000020:00010000:2.0:1788658525.904439:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e57007bc800: total 0 00010000:00010000:2.0:1788658525.904482:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e57007bc800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788658525.904516:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cdc00/0xf657f176650eab08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8aca6 expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.904549:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e57007bc800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788658525.904561:0:5826:0:(genops.c:885:class_export_put()) final put ffff9e57007bc800/f5e2ec63-51f5-4911-9a1f-c6731fda8201 00010000:00010000:2.0:1788658525.904577:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658525.904579:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658525.904580:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658525.904626:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e57007bc800/f5e2ec63-51f5-4911-9a1f-c6731fda8201 for MGS 00000020:00000080:0.0:1788658525.904659:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e57007bd000 for MGS 00010000:00010000:3.0:1788658525.981244:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658526.111110:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103797760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658526.111186:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658526.111305:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103797760 00000100:00100000:0.0:1788658526.111313:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103797760 00000100:00100000:0.0:1788658526.111362:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658526.111373:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103797760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658526.111422:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658526.116660:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103797760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5277us (5462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658526.116689:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788658526.120061:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103797760:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788658526.627092:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658526.627108:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658526.627652:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788658526.627662:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788658526.700042:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1788658526.700070:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5097b18f-92da-45ff-9ffe-4c6d955a08f5 00000001:00080000:3.0:1788658526.700078:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788658526.700083:0:5859:0:(genops.c:885:class_export_put()) final put ffff9e5700519000/5097b18f-92da-45ff-9ffe-4c6d955a08f5 00000001:00100000:3.0:1788658526.700102:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000001:00080000:3.0:1788658526.700107:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788658526.700120:0:5859:0:(genops.c:885:class_export_put()) final put ffff9e570051b000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:3.0:1788658526.700191:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5700519000/5097b18f-92da-45ff-9ffe-4c6d955a08f5 for lustre-MDT0000 00000020:00000080:3.0:1788658526.700262:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e570051b000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 for lustre-MDT0000 00000020:00000080:3.0:1788658526.700297:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e570051b800 for lustre-MDT0000 00000020:00000080:3.0:1788658526.700304:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e570051a800 for lustre-MDT0000 00000001:00100000:0.0:1788658526.703999:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:0.0:1788658526.704012:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e56ff010000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:3.0:1788658526.704100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff010000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 for lustre-OST0000 00000020:00000080:3.0:1788658526.704165:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56ff016800 for lustre-OST0000 00010000:00010000:3.0:1788658527.011813:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658527.723256:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:3.0:1788658527.723267:0:7647:0:(genops.c:885:class_export_put()) final put ffff9e56fefa8000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 00000020:00000080:0.0:1788658527.723447:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fefa8000/df8d83e3-27bc-4e5d-ab80-c17af5c0fb38 for lustre-OST0001 00000020:00000080:0.0:1788658527.723546:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56c6ae8800 for lustre-OST0001 00010000:00010000:2.0:1788658528.051901:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788658528.193398:0:13021:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788658528.212401:0:13021:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788658528.212455:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.212471:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.212479:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.212486:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.212510:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658528.212515:0:13021:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788658528.212539:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658528.212543:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788658528.212548:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788658528.212573:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9e5700599000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788658528.212809:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103797888:0@lo:39:umount.0 00000100:00100000:0.0:1788658528.212882:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658528.212987:0:11367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103797888 00000100:00100000:2.0:1788658528.212996:0:11367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103797888 00000100:00100000:2.0:1788658528.213048:0:11367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788658528.213058:0:11367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875544103797888:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788658528.213102:0:11367:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea86f 00000100:00080000:2.0:1788658528.213111:0:11367:0:(import.c:65:import_set_state_nolock()) ffff9e570059d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788658528.213171:0:11367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875544103797888:12345-0@lo:39:umount.0 Request processed in 114us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658528.213179:0:11367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788658528.213190:0:11367:0:(genops.c:885:class_export_put()) final put ffff9e570059c800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788658528.213286:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e5700599000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1788658528.213385:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658528.213393:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.213401:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678400 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658528.213405:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.213427:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658528.213435:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658528.213440:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658528.213443:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788658528.213445:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788658528.213471:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.213478:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658528.213500:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.213508:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650eaad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.213521:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.213522:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.213524:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.213533:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788658528.213541:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e570059c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658528.213596:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e570059d800 for lustre-MDT0000 00000100:00100000:3.0:1788658528.213614:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103798016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658528.213659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658528.213725:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103798016 00000100:00100000:3.0:1788658528.213729:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103798016 00000100:00100000:3.0:1788658528.213773:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658528.213781:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103798016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658528.213791:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658528.213804:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29df200/0xf657f176650eaade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaad7 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.213818:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658528.213848:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88ab4306-42c5-43ae-b202-256d86278024+18:3304:x1875544103798016:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658528.213854:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658528.213879:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103798016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658528.214053:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103797888:0@lo:39:umount.0 00000100:00080000:2.0:1788658528.214354:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658528.214358:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788658528.214363:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788658528.215216:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215229:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215237:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215244:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215266:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658528.215273:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215280:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215287:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215304:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215316:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658528.215323:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215347:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215353:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215360:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215371:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788658528.215376:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215383:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215389:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215395:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.215413:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788658528.215417:0:13021:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788658528.215444:0:13021:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788658528.215449:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788658528.215453:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658528.215458:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788658528.215464:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e56ff62e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788658528.215469:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e57006cf800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788658528.215474:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e56fb3bb380) has exports, disconnecting them 00000020:00080000:2.0:1788658528.215480:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e56ff62e800), last request at 1788658525 00000020:00000080:2.0:1788658528.215487:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea9d4 00000100:00080000:2.0:1788658528.215506:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9e56ff62b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788658528.215548:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56ff62e800): rc 0 00000020:00000080:2.0:1788658528.215551:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56ff62e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788658528.215558:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e57006cf800), last request at 1788658525 00000020:00000080:2.0:1788658528.215561:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea909 00000100:00080000:2.0:1788658528.215567:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9e57006cb000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788658528.215573:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e57006cf800): rc 0 00000020:00000080:2.0:1788658528.215575:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e57006cf800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788658528.215583:0:13021:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbdf241c93ae0 00000100:00080000:2.0:1788658528.215606:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788658528.215609:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788658528.215621:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788658528.215698:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788658528.215715:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9e56de8c1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788658528.215728:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788658528.215730:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788658528.215745:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788658528.215802:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788658528.215813:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9e57007b9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788658528.215840:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e56fb3bb380) has no exports 00010000:00010000:3.0:1788658528.216056:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788658528.216064:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216072:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658528.216075:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216085:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658528.216092:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658528.216098:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658528.216101:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788658528.216103:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788658528.216127:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216140:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658528.216165:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216172:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650eaae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaaec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216183:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788658528.216186:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216191:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0031600 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658528.216194:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216201:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658528.216207:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658528.216213:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658528.216215:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788658528.216217:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788658528.216231:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216237:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658528.216253:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216270:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0031600/0xf657f176650eaa0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaa13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216285:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658528.216289:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216295:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efa00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658528.216298:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216305:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658528.216311:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658528.216316:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788658528.216319:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788658528.216320:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788658528.216344:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216350:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658528.216357:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216363:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ead00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ead07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216383:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658528.216386:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216392:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c0030800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658528.216394:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216401:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658528.216407:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658528.216413:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658528.216415:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788658528.216417:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788658528.216430:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216436:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658528.216442:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216448:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0030800/0xf657f176650ea7c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ea7c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.216460:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.216462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.216470:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.216477:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.216481:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788658528.216488:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff62e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658528.216523:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e57006cf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658528.216544:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56ff62b800 for lustre-MDT0000 00000020:00000080:3.0:1788658528.216549:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e57006cb000 for lustre-MDT0000 00000100:00100000:3.0:1788658528.216564:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103798784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658528.216627:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658528.216766:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103798400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658528.216883:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103798656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658528.216907:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658528.216925:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658528.216930:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103798528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658528.216950:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658528.216980:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103798784 00000100:00100000:3.0:1788658528.216986:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103798784 00000100:00100000:3.0:1788658528.217031:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103798656 00000100:00100000:3.0:1788658528.217034:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103798656 00000100:00100000:3.0:1788658528.217046:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103798528 00000100:00100000:3.0:1788658528.217048:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103798528 00000100:00100000:3.0:1788658528.217061:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658528.217068:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+20:3304:x1875544103798784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658528.217079:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658528.217091:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29de400/0xf657f176650ea7c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ea7c0 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.217105:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658528.217138:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+19:3304:x1875544103798784:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658528.217150:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658528.217166:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658528.217171:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+18:3307:x1875544103798656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658528.217179:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658528.217188:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891a400/0xf657f176650ead07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ead00 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.217197:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658528.217223:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+17:3307:x1875544103798656:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658528.217229:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658528.217240:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658528.217245:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+16:3307:x1875544103798528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658528.217252:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658528.217261:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c0030e00/0xf657f176650eaa13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaa0c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658528.217271:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658528.217291:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88ab4306-42c5-43ae-b202-256d86278024+15:3307:x1875544103798528:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658528.217297:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658528.217343:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103798784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658528.217368:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103798528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658528.217376:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88ab4306-42c5-43ae-b202-256d86278024:3307:1875544103798656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658528.217422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658528.217518:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103798400 00000100:00100000:0.0:1788658528.217522:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103798400 00000100:00100000:0.0:1788658528.217557:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658528.217565:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+15:3305:x1875544103798400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658528.217573:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658528.217582:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678800/0xf657f176650eaaec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaae5 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658528.217592:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658528.217623:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88ab4306-42c5-43ae-b202-256d86278024+14:3305:x1875544103798400:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658528.217630:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658528.218115:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103798400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658528.218138:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103798144:0@lo:9:umount.0 00000100:00100000:0.0:1788658528.218170:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658528.218191:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103798272:0@lo:9:umount.0 00000100:00100000:0.0:1788658528.218212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658528.218250:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103798144 00000100:00100000:0.0:1788658528.218254:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103798144 00000100:00100000:0.0:1788658528.218284:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103798272 00000100:00100000:0.0:1788658528.218288:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103798272 00000100:00100000:0.0:1788658528.218308:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658528.218315:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875544103798144:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788658528.218346:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea956 00000100:00080000:0.0:1788658528.218354:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9e56ff3d2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658528.218386:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788658528.218804:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788658528.218821:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875544103798272:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788658528.218838:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eaa3d 00000100:00080000:3.0:1788658528.218844:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9e57007ba000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788658528.218865:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788658528.219099:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1875544103798272:12345-0@lo:9:umount.0 Request processed in 278us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658528.219106:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1788658528.219129:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.219134:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788658528.219165:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e57007b9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788658528.219177:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788658528.219179:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788658528.219182:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103798272:0@lo:9:umount.0 00000100:00100000:0.0:1788658528.219376:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3303:x1875544103798144:12345-0@lo:9:umount.0 Request processed in 1061us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658528.219383:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788658528.219399:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658528.219402:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658528.219832:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56de8c1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788658528.219882:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788658528.223202:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788658528.223217:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103798144:0@lo:9:umount.0 00000020:00080000:0.0:1788658528.231088:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e56fb3bb380) has no exports 00000020:00000080:0.0:1788658528.293963:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea81b 00000020:00000080:0.0:1788658528.293980:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e57014ea000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788658528.294040:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788658528.294365:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e57014ea000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788658528.294467:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.294479:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788658528.294485:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e56c82099c0) has no exports 00000020:00000080:1.0:1788658528.295346:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea814 00000020:00000080:1.0:1788658528.295353:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56e5c8e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788658528.295477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56e5c8e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788658528.295544:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.295552:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788658528.295555:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56e5c89000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788658528.295558:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56e5c89000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788658528.295936:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788658528.296072:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56c59b63c0 - data ffff9e56ffda5d80/ffff9e57004e8c00 00000020:01000000:1.0:1788658528.296339:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56c59b6a80 - data ffff9e56ef464bd0/ffff9e56d002e800 00000001:00000004:1.0:1788658528.315857:0:13021:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1788658528.397603:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788658528.397612:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788658528.397639:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658528.397642:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788658528.398227:0:6733:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788658528.398232:0:6733:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788658528.398242:0:6733:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788658528.400193:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788658528.400199:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788658528.400227:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658528.400230:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788658528.400536:0:8094:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788658528.400541:0:8094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788658528.400554:0:8094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788658528.483368:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea7e3 00000020:00000080:1.0:1788658528.483386:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56fb3ad800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788658528.483913:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fb3ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788658528.485464:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea7f8 00000020:00000080:1.0:1788658528.485475:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e5701483000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788658528.485529:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788658528.485535:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.485545:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658528.485549:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e56fb3bcd40) has no exports 00000004:01000000:1.0:1788658528.487795:0:13021:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788658528.487814:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eaa36 00000020:00000080:1.0:1788658528.487825:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e570051f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788658528.489923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5701483000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788658528.490077:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788658528.490088:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.490099:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788658528.490104:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e56c83e19c0) has no exports 00000020:00000080:1.0:1788658528.490113:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eaa2f 00000020:00000080:1.0:1788658528.490120:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e570051a000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788658528.490479:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788658528.490484:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788658528.490488:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788658528.490494:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788658528.490496:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658528.490529:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.490536:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658528.490542:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea94f 00000020:00000080:1.0:1788658528.490546:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e5700dc4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788658528.490553:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788658528.490557:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.490575:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788658528.490577:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e56c83e0000) has no exports 00000020:00000080:1.0:1788658528.490581:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea948 00000020:00000080:1.0:1788658528.490585:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56de8c0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788658528.490862:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e570051f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788658528.490870:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e570051a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788658528.490876:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e57007b9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788658528.490882:0:36:0:(genops.c:885:class_export_put()) final put ffff9e570051d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788658528.490883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e570051d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788658528.490887:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658528.490951:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5700dc4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788658528.490956:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56de8c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788658528.491377:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788658528.491380:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788658528.491383:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788658528.491388:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788658528.491389:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658528.491459:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.491466:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658528.491493:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.491497:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658528.491501:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56fb3ac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658528.491503:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fb3ac000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788658528.491508:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658528.491789:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea7ff 00000020:00000080:1.0:1788658528.491796:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e5701487800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788658528.492262:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56de8c1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788658528.492269:0:36:0:(genops.c:885:class_export_put()) final put ffff9e56de8c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788658528.492271:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56de8c6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788658528.492277:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788658528.492425:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788658528.492430:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.492435:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658528.492440:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e56fb3b8000) has no exports 00000020:00000080:1.0:1788658528.492462:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.492466:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788658528.492470:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea806 00000020:00000080:1.0:1788658528.492475:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e5701482000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788658528.492483:0:13021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56f44c2000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788658528.492486:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56f44c2000 3 00000020:01000004:1.0:1788658528.492489:0:13021:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e56f44c2000 from lustre-MDT0000 00000020:00000080:1.0:1788658528.492509:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.492513:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788658528.492516:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56fb3a9000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788658528.492524:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fb3a9000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788658528.492530:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788658528.492559:0:13021:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788658528.492564:0:13021:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788658528.492567:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788658528.492570:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.492573:0:13021:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658528.492579:0:13021:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e56c63de800 88ab4306-42c5-43ae-b202-256d86278024 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658528.492584:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e56c8208000) has exports, disconnecting them 00000020:00080000:1.0:1788658528.492589:0:13021:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e56c63de800), last request at 1788658302 00000020:00000080:1.0:1788658528.492603:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea7a4 00000020:00010000:1.0:1788658528.492607:0:13021:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e56c63de800: total 2 00000020:00000080:2.0:1788658528.492915:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5701487800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788658528.492920:0:36:0:(genops.c:885:class_export_put()) final put ffff9e56fb3ad000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788658528.492922:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fb3ad000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788658528.492927:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788658528.493102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5701482000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1788658528.493149:0:13021:0:(import.c:65:import_set_state_nolock()) ffff9e56c63db800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788658528.493172:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56c63de800): rc 0 00000020:00080000:1.0:1788658528.493177:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e56c8208000) has no exports 00000020:00010000:2.0:1788658528.493302:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e56c63de800: total 0 00010000:00010000:2.0:1788658528.493334:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e56c63de800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788658528.493368:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79400/0xf657f176650eaaa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaa9f expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493385:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac78600/0xf657f176650eaab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaaad expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493395:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cca00/0xf657f176650eaac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaabb expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493406:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cc400/0xf657f176650eaad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaac9 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493417:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ef800/0xf657f176650eaceb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eace4 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493427:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ee200/0xf657f176650eacf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eacf2 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493441:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dfc00/0xf657f176650ea8bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ea8b5 expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493453:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dfe00/0xf657f176650eaafa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650eaaf3 expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658528.493477:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e56c63de800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788658528.493491:0:5825:0:(genops.c:885:class_export_put()) final put ffff9e56c63de800/88ab4306-42c5-43ae-b202-256d86278024 00010000:00010000:2.0:1788658528.493512:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658528.493514:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658528.493516:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788658528.493550:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c63de800/88ab4306-42c5-43ae-b202-256d86278024 for MGS 00000020:00000080:1.0:1788658528.493582:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56c63db800 for MGS 00000100:00100000:2.0:1788658528.494465:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e56c9421400:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1788658528.494578:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e56c9421a00:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1788658528.494928:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e56c823b200:5830] 0 exiting: rc = 1 00000100:00100000:0.0:1788658528.500248:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500260:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500268:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500275:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500294:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500300:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500317:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500326:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500332:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500338:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500345:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500370:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500376:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500381:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500387:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500393:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500398:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500405:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500411:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500418:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500427:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500433:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500439:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500447:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500452:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500459:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500468:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500474:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500480:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500486:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500491:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500496:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500501:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500506:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500511:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500517:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500522:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500528:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500533:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500539:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500544:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500549:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500554:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500560:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500564:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500569:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500583:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500588:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500594:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500600:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500605:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500624:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500631:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500637:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500642:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500652:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500915:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500925:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500931:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500937:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500942:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500949:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500954:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658528.500960:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788658528.501360:0:13021:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788658528.501364:0:13021:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788658528.503145:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e57004e4120 - data ffff9e56ffcb6798/ffff9e56ff3e2c00 00000020:01000000:0.0:1788658528.503252:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56d6eaa2a0 - data ffff9e56ef439948/ffff9e56c5673c00 00000020:00000080:1.0:1788658528.506034:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea788 00000020:00000080:1.0:1788658528.506046:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56f44c4800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788658528.506099:0:13021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56f44c2000 from MGS, refs=2 00000020:01000004:1.0:1788658528.506103:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56f44c2000 2 00000020:01000004:1.0:1788658528.506106:0:13021:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e56f44c2000 from MGS 00000020:00000080:1.0:1788658528.506134:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.506143:0:13021:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788658528.506146:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56f44c7000/MGS 00000020:00000080:1.0:1788658528.506149:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56f44c7000/MGS for MGS 00000020:01000000:1.0:1788658528.506163:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788658528.506223:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788658528.506228:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.506234:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658528.506250:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e56c61c5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658528.506255:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9e56c820cd40) has exports, disconnecting them 00000020:00080000:1.0:1788658528.506260:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e56c61c5800), last request at 1788658303 00000020:00000080:1.0:1788658528.506265:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea853 00000020:00080000:1.0:1788658528.506277:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56c61c5800): rc 0 00000020:00000080:1.0:1788658528.506281:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56c61c5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788658528.506541:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56f44c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788658528.508291:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c61c5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788658528.509785:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788658528.509794:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658528.509798:0:13021:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658528.509806:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658528.509977:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658528.509986:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788658528.509993:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56f44c2000 1 00000020:00000080:1.0:1788658528.509999:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea77a 00000020:00000080:1.0:1788658528.510008:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56f44c3800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788658528.510014:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788658528.510018:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658528.510022:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658528.510027:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e56c8910000) has no exports 00000020:00000080:2.0:1788658528.510479:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5700599000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788658528.510486:0:8:0:(genops.c:885:class_export_put()) final put ffff9e56e5c8d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788658528.510489:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56e5c8d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788658528.510496:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788658528.510551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56f44c3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788658528.550497:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658528.550513:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788658528.550519:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56f446f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788658528.550524:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56f446f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788658528.550530:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788658528.550961:0:13021:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e56f44c4000 00000020:01000000:2.0:1788658528.550994:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788658528.550999:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658528.551004:0:13021:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788658528.551007:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e56c56c4d40) has no exports 00000100:00100000:2.0:1788658528.551088:0:6710:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e56ff39d600:6710] 3 exiting: rc = 0 00000100:00100000:2.0:1788658528.551188:0:11367:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e56ff57e400:11367] 4 exiting: rc = 0 00000100:00100000:1.0:1788658528.554501:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e56c88b6000:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1788658528.555514:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e56c5cfe800:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1788658528.561235:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e56c56a6000:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1788658528.561460:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561469:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561475:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561492:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561497:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561503:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561508:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561514:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561520:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561524:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561530:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561540:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561545:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561581:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561589:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561595:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561600:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561606:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561623:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561628:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561634:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561639:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561645:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561657:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561771:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561779:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561786:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561792:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561797:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561803:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561809:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561816:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561822:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561827:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561832:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561838:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561843:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561848:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561862:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561867:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561873:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561877:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561882:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561888:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561893:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561898:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561905:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561910:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561915:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561921:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561926:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561931:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561936:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561941:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561946:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561951:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561956:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561961:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561967:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561972:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561978:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561983:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561990:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.561997:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.567518:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e56c88b6600:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1788658528.567884:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e56c88b7200:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788658528.568074:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568083:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568090:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568097:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568102:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568107:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568115:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568121:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568127:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568144:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568151:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568157:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568164:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568169:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568174:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568179:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568184:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568189:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568195:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568200:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568206:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568211:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568216:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568221:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568226:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568231:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568236:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568241:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568246:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568251:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568257:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568263:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568268:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568273:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568278:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568282:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568287:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568293:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568309:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568315:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568320:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568325:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568329:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568334:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568346:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568351:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568355:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568360:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568366:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568371:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568376:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568381:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568386:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568391:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568396:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568401:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568406:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568411:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568417:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568422:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568426:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568431:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568435:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.568440:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.569148:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e56c9433800:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1788658528.570041:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e56c9433000:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788658528.570169:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570186:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570192:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570198:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570205:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570223:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570231:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570237:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570243:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570249:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570255:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570261:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570267:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570288:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570296:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570312:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570318:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570326:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570332:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570336:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570344:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570353:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570358:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570363:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570369:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570388:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570394:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570400:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570405:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570411:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570417:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570422:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570427:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570432:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570438:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570443:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570448:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570467:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570475:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570481:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570491:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570497:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570503:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570509:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570515:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570522:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570527:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570533:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570538:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570558:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570566:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570571:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570576:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570582:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570588:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570594:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.570603:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.571002:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.571010:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.571015:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.571020:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.571039:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.571046:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.571054:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.581536:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e56c9432c00:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1788658528.582101:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e56c9433e00:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788658528.585843:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585854:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585859:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585864:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585869:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585874:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585879:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585884:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585888:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585893:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585898:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585905:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585910:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585934:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585939:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585944:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585950:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585954:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585959:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585965:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585971:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585977:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585983:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585988:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585993:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.585998:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586003:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586008:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586013:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586018:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586023:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586028:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586033:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586038:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586045:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586050:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586055:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586061:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586066:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586071:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586076:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586081:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586086:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586090:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586095:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586100:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586105:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586110:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586122:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586128:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586133:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586139:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586144:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586150:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586155:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586159:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586163:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586167:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586172:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586177:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586182:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586187:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586191:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586197:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586601:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e56c9433c00:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1788658528.586736:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e56c9432a00:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788658528.586786:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586793:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586799:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586804:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586809:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586814:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586819:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586824:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586830:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586835:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586841:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586846:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586852:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586857:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586862:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586868:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586873:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586886:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586891:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586896:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586902:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586907:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586912:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586918:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586923:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586928:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586933:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586939:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586944:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586962:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586969:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586974:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586979:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586985:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586989:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586994:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.586999:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587005:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587010:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587015:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587020:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587026:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587032:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587037:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587042:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587047:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587052:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587058:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587063:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587068:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587073:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587079:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587092:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587097:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587102:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587107:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587112:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587117:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587123:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587127:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587132:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587137:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587142:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587146:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.587468:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e56c838b200:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1788658528.588411:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e56c838a200:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1788658528.589159:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589166:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589171:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589175:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589180:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589186:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589191:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589195:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589201:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589206:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589211:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589216:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589223:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589228:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589233:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589237:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589243:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589248:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589252:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589257:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589262:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589267:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589281:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589286:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589291:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589307:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589313:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589318:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589323:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589328:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589334:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589339:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589344:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589350:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589355:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589360:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589365:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589370:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589375:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589380:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589384:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589389:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589395:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589400:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589404:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589410:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589415:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589420:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589425:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589430:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589435:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589441:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589446:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589451:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589457:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589463:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589469:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589481:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589486:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589491:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589496:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589500:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589505:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.589510:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658528.595460:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e56c838a400:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1788658528.595957:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e56c88b7400:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1788658528.596881:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e56de4a8800:5852] 2 exiting: rc = 0 00000100:00100000:2.0:1788658528.597256:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597264:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597270:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597276:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597282:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597287:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597318:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597325:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597330:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597336:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597341:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597346:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597352:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597357:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597362:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597367:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597374:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597379:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597384:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597390:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597395:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597402:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597411:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597416:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597421:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597427:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597433:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597450:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597456:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597462:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597480:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597487:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597493:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597498:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597504:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597510:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597515:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597521:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597527:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597533:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597539:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597544:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597550:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597557:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597563:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597569:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597575:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597581:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597587:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597592:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597597:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597961:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597973:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.597980:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598001:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598009:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598015:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598021:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598027:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598034:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598039:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598045:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598059:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658528.598065:0:13021:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788658528.602518:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658528.602532:0:13021:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788658528.602538:0:13021:0:(genops.c:885:class_export_put()) final put ffff9e56d00a0000/MDS_uuid 00000020:00000080:2.0:1788658528.602543:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d00a0000/MDS_uuid for MDS 00000020:01000000:2.0:1788658528.602557:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788658528.603305:0:13021:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788658529.053224:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658530.078874:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658530.718076:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103798912:0@lo:400:kworker.0 00000400:00000100:1.0:1788658530.718140:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544103798912 offset 0 length 224: 4 00000100:00100000:1.0:1788658530.718199:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103799040:0@lo:400:kworker.0 00000400:00000100:1.0:1788658530.718218:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103799040 offset 0 length 224: 4 00000100:00100000:1.0:1788658530.718230:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658530.718235:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103799168:0@lo:400:kworker.0 00000400:00000100:1.0:1788658530.718259:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103799168 offset 0 length 224: 4 00010000:00010000:2.0:1788658531.101247:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788658531.351082:0:13170:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788658531.363860:0:13170:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788658531.363914:0:13170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658531.363930:0:13170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658531.363937:0:13170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658531.363943:0:13170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658531.363966:0:13170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658531.363972:0:13170:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788658531.363994:0:13170:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658531.364008:0:13170:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e570056b100 x1875544103799040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658531.364028:0:13170:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788658531.364033:0:13170:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788658531.364071:0:13170:0:(import.c:65:import_set_state_nolock()) ffff9e56ff3d0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788658531.364125:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658531.364133:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658531.364141:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658531.364158:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658531.364167:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658531.364176:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658531.364182:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658531.364184:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788658531.364187:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788658531.364210:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658531.364217:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658531.364246:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658531.364254:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd000/0xf657f176650eaabb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650eaac2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658531.364265:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658531.364267:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658531.364269:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658531.364285:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103799296:0@lo:39:umount.0 00000400:00000100:3.0:1788658531.364331:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103799296 offset 0 length 224: 4 00000100:00100000:2.0:1788658531.364422:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103799424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658531.364466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658531.364542:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103799424 00000100:00100000:3.0:1788658531.364550:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103799424 00000100:00100000:3.0:1788658531.364600:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658531.364607:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56cad4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875544103799424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788658531.364620:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658531 with bad export cookie 17750921947107993508 00000100:00100000:1.0:1788658531.368952:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103799040:0@lo:400:kworker.0 00000100:00100000:3.0:1788658531.371708:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56cad4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875544103799424:12345-0@lo:103:ldlm_bl.0 Request processed in 7094us (7236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788658531.371722:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788658531.371802:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788658531.371807:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9e56d00a5000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788658531.371811:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788658531.380872:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.103@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788658531.380878:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788658531.380887:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5700568000 x1875544103798912/t0(0) o400->MGC192.168.202.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788658546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658531.380913:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e56fefdb100 x1875544103799424/t0(0) o103->MGC192.168.202.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658547 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788658531.380921:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788658531.380924:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788658531.380925:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788658531.380929:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9e56d00a5000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658531.380934:0:3304:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 193 00000100:00080000:3.0:1788658531.380943:0:3304:0:(import.c:665:import_select_connection()) MGC192.168.202.103@tcp: import ffff9e56d00a5000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658531.380973:0:3304:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefd9c00 x1875544103799552/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658531.381012:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88ab4306-42c5-43ae-b202-256d86278024:3303:1875544103799552:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:2.0:1788658531.381301:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88ab4306-42c5-43ae-b202-256d86278024:3305:1875544103798912:0@lo:400:kworker.0 00000400:00000100:3.0:1788658531.381340:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544103799552 offset 0 length 520: 4 00000100:00100000:3.0:1788658531.381454:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88ab4306-42c5-43ae-b202-256d86278024:3304:1875544103799424:0@lo:103:ldlm_bl.0 00000001:00100000:0.0:1788658531.804660:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788658531.804756:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e56ff3d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788658531.804815:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff3d6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788658531.804862:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56ff3d2000 for lustre-OST0000 00010000:00010000:3.0:1788658532.124964:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658532.842353:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788658532.842377:0:7647:0:(genops.c:885:class_export_put()) final put ffff9e57007bf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788658532.842446:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e57007bf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788658532.842500:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e57007ba000 for lustre-OST0001 00010000:00010000:2.0:1788658533.149119:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658534.172924:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658535.199561:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658535.837631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658535.837640:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788658535.837795:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658535.837818:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103799680:0@lo:400:kworker.0 00000400:00000100:3.0:1788658535.837871:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103799680 offset 0 length 224: 4 00010000:00010000:2.0:1788658536.220917:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658536.860911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658536.860921:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658536.861118:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103799808:0@lo:400:kworker.0 00000400:00000100:1.0:1788658536.861186:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103799808 offset 0 length 224: 4 00010000:00010000:3.0:1788658537.244995:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658538.268909:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658539.292884:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658540.317031:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658541.341195:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658541.980876:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658531/real 1788658531] req@ffff9e56fefd9c00 x1875544103799552/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788658541 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658541.980912:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e56fefd9c00 x1875544103799552/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788658541 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658541.980924:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658531/real 1788658531] req@ffff9e55c2403800 x1875544103799296/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658541 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658541.980935:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e55c2403800 x1875544103799296/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658541 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788658541.981227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658541.981231:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658541.981262:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d00a5000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658541.981283:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788658541.981288:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88ab4306-42c5-43ae-b202-256d86278024:3303:1875544103799552:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788658541.981295:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56ff3d0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788658541.981308:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103799296:0@lo:39:umount.0 00000100:00100000:2.0:1788658541.981324:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658541.981335:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103799936:0@lo:400:kworker.0 00000400:00000100:2.0:1788658541.981375:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103799936 offset 0 length 224: 4 00000100:00080000:0.0:1788658541.981726:0:13170:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658541.981745:0:13170:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788658541.981750:0:13170:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788658541.982524:0:13170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982536:0:13170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982541:0:13170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982546:0:13170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982560:0:13170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658541.982566:0:13170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982572:0:13170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982577:0:13170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982583:0:13170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658541.982595:0:13170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788658541.982599:0:13170:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788658541.982619:0:13170:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788658541.982623:0:13170:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788658541.982632:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658541.982636:0:13170:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788658541.982639:0:13170:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e56c56c0000) has no exports 00000020:00080000:0.0:1788658541.982659:0:13170:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e56c56c0000) has no exports 00010000:00010000:2.0:1788658541.984560:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658541.984572:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658541.984583:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cce00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658541.984588:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658541.984598:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658541.984605:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658541.984611:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658541.984618:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788658541.984621:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000100:00080000:1.0:1788658541.984650:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:2.0:1788658541.984653:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56d00a5000 00000100:00080000:1.0:1788658541.984655:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00010000:00010000:2.0:1788658541.984657:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788658541.984658:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56d00a5000 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1788658541.984682:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cce00/0xf657f176650eaac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaad0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788658541.984683:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 422 00000100:00080000:1.0:1788658541.984689:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658541.984694:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.103@tcp: import ffff9e56d00a5000 using connection 192.168.202.103@tcp/0@lo 00010000:00010000:2.0:1788658541.984695:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658541.984699:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658541.984703:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658541.984706:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658541.984712:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658541.984718:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658541.984723:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788658541.984725:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788658541.984727:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1788658541.984730:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5700569180 x1875544103800064/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1788658541.984732:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56d00a5000 00010000:00010000:2.0:1788658541.984734:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658541.984741:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c891b800/0xf657f176650eacf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eacf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658541.984748:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658541.984750:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658541.984756:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658541.984782:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788658541.984854:0:13170:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56facb79c0 - data ffff9e56ffdaea20/ffff9e57004e2800 00000020:01000000:3.0:1788658541.984972:0:13170:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56d0e7ec00 - data ffff9e56f9730360/ffff9e56ff0ed400 00000100:00100000:1.0:1788658541.985445:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88ab4306-42c5-43ae-b202-256d86278024:3303:1875544103800064:0@lo:250:kworker.0 00000400:00000100:1.0:1788658541.985506:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544103800064 offset 0 length 520: 4 00100000:10000000:3.0:1788658541.998280:0:13170:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788658542.028502:0:13170:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea8d8 00000020:00000080:2.0:1788658542.028514:0:13170:0:(genops.c:885:class_export_put()) final put ffff9e56d183c000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788658542.028537:0:13170:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e57014ee800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788658542.028542:0:13170:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e57014ee800 2 00000020:01000004:2.0:1788658542.028545:0:13170:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e57014ee800 from lustre-OST0000 00000020:00000080:2.0:1788658542.028577:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658542.028586:0:13170:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788658542.028589:0:13170:0:(genops.c:885:class_export_put()) final put ffff9e56d1839800/lustre-OST0000_UUID 00000020:00000080:2.0:1788658542.028592:0:13170:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d1839800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788658542.028598:0:13170:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788658542.028647:0:13170:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788658542.028652:0:13170:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788658542.028656:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658542.028661:0:13170:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788658542.028697:0:13170:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e56ff3d3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788658542.028703:0:13170:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9e56c820b380) has exports, disconnecting them 00000020:00080000:2.0:1788658542.028707:0:13170:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e56ff3d3000), last request at 1788658319 00000020:00000080:2.0:1788658542.028869:0:13170:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea902 00000020:00080000:2.0:1788658542.028881:0:13170:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56ff3d3000): rc 0 00000020:00000080:2.0:1788658542.028887:0:13170:0:(genops.c:885:class_export_put()) final put ffff9e56ff3d3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788658542.029908:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d183c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788658542.029921:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff3d3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788658542.030709:0:13170:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788658542.030725:0:13170:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658542.030729:0:13170:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788658542.030735:0:13170:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658542.030890:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658542.030898:0:13170:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788658542.030905:0:13170:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e57014ee800 1 00000020:00000080:1.0:1788658542.031193:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56ff3d0800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788658542.031202:0:8:0:(genops.c:885:class_export_put()) final put ffff9e56ff3d4800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788658542.031205:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff3d4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788658542.031215:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788658542.031291:0:13170:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea892 00000020:00000080:0.0:1788658542.031298:0:13170:0:(genops.c:885:class_export_put()) final put ffff9e56c6aeb000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788658542.031312:0:13170:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788658542.031317:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658542.031322:0:13170:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788658542.031326:0:13170:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e56c56c3380) has no exports 00000020:00000080:1.0:1788658542.032448:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c6aeb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788658542.046522:0:13170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658542.046538:0:13170:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788658542.046543:0:13170:0:(genops.c:885:class_export_put()) final put ffff9e57014e8800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788658542.046568:0:13170:0:(genops.c:844:class_export_destroy()) destroying export ffff9e57014e8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788658542.046575:0:13170:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788658542.046763:0:13170:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e57014eb800 00000020:02000400:1.0:1788658542.046807:0:13170:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788658542.369310:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658543.391217:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658544.413230:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658544.590370:0:13324:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788658544.600939:0:13324:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788658544.601033:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658544.601046:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658544.601051:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658544.601068:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658544.601084:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658544.601089:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788658544.601105:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658544.601111:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788658544.601114:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1788658544.601118:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658544.601121:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658544.601125:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5700568e00 x1875544103799168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788658544.601130:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658544.601138:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658544.601144:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658544.601146:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788658544.601149:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788658544.601162:0:8450:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56d00a5000 00010000:00010000:3.0:1788658544.601166:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.601172:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cc200/0xf657f176650eaa9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaaa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658544.601182:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e56ff646d80 x1875544103799680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788658544.601183:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658544.601185:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658544.601186:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658544.601201:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e56ff644700 x1875544103799808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658552 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658544.601210:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e570056b100 x1875544103799936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658544.601218:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788658544.601224:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788658544.601248:0:13324:0:(import.c:65:import_set_state_nolock()) ffff9e56ff629800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788658544.601301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103800192:0@lo:39:umount.0 00000400:00000100:3.0:1788658544.601354:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103800192 offset 0 length 224: 4 00000100:00100000:1.0:1788658544.601497:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875544103799680:0@lo:400:kworker.0 00000100:00100000:0.0:1788658544.601537:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103799168:0@lo:400:kworker.0 00000100:00100000:0.0:1788658544.601549:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103799936:0@lo:400:kworker.0 00000100:00100000:0.0:1788658544.601553:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103799808:0@lo:400:kworker.0 00010000:00010000:2.0:1788658545.436906:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658546.462271:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658547.101751:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658547.101763:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788658547.485227:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658548.509032:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658549.536170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658550.560133:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658551.582498:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658552.220805:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658552.220816:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88ab4306-42c5-43ae-b202-256d86278024->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788658552.607846:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658553.628912:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658554.653803:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658554.849697:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658544/real 1788658544] req@ffff9e55c2403480 x1875544103800192/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658554.849742:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e55c2403480 x1875544103800192/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658554.849766:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56ff629800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788658554.849787:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103800192:0@lo:39:umount.0 00000100:00080000:2.0:1788658554.850020:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658554.850026:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788658554.850032:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788658554.851034:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851065:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851074:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851083:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851119:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658554.851128:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851135:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851142:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851148:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.851168:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788658554.851173:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788658554.851200:0:13324:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788658554.851206:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788658554.851211:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658554.851218:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788658554.851233:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e56c644b380) has no exports 00000020:00080000:2.0:1788658554.851265:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e56c644b380) has no exports 00010000:00010000:0.0:1788658554.853410:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658554.853428:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853442:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678e00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658554.853447:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853482:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658554.853491:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658554.853498:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658554.853500:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788658554.853505:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788658554.853535:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56d00a5000 00010000:00010000:0.0:1788658554.853540:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853548:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1678e00/0xf657f176650eaaad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaab4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853569:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658554.853574:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853580:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679c00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658554.853583:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853599:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658554.853605:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658554.853621:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788658554.853624:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788658554.853626:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788658554.853634:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56d00a5000 00010000:00010000:0.0:1788658554.853637:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853643:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1679c00/0xf657f176650eace4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658554.853658:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658554.853659:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658554.853661:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658554.853904:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788658554.860042:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56facb78a0 - data ffff9e56f97b5ca8/ffff9e57004e0400 00000020:01000000:2.0:1788658554.860220:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56c6b4ff00 - data ffff9e56ffda7510/ffff9e56ff96fc00 00100000:10000000:2.0:1788658554.884015:0:13324:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788658554.938631:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea9a3 00000020:00000080:2.0:1788658554.938647:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56c6aee800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788658554.938695:0:13324:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56fef6c800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788658554.938700:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56fef6c800 2 00000020:01000004:2.0:1788658554.938703:0:13324:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e56fef6c800 from lustre-OST0001 00000020:00000080:2.0:1788658554.938732:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658554.938745:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788658554.938748:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56c6ae9000/lustre-OST0001_UUID 00000020:00000080:2.0:1788658554.938752:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c6ae9000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788658554.938760:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788658554.939046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c6aee800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1788658554.939206:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 88ab4306-42c5-43ae-b202-256d86278024->MGS 00010000:00010000:2.0:1788658554.939228:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ea8bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658554.939243:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ea8bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658554.939251:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788658554.939254:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788658554.939258:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788658554.939276:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56d00a5000 00010000:00010000:2.0:1788658554.939280:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c0031a00/0xf657f176650ea8b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ea8bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658554.939299:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650eaafa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658554.939325:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650eaafa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658554.939331:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658554.939334:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788658554.939335:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788658554.939346:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56d00a5000 00010000:00010000:2.0:1788658554.939349:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650eaaf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650eaafa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788658554.939429:0:13324:0:(import.c:65:import_set_state_nolock()) ffff9e56d00a5000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788658554.939435:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788658554.939438:0:13324:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788658554.939439:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788658554.939445:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788658554.939460:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5700569180 x1875544103800064/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788658556 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788658554.939528:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788658554.939532:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1788658554.944657:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88ab4306-42c5-43ae-b202-256d86278024:3303:1875544103800064:0@lo:250:kworker.0 10000000:01000000:2.0:1788658554.944967:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788658554.944985:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea796 00000020:00000080:2.0:1788658554.944997:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56d00a4800/88ab4306-42c5-43ae-b202-256d86278024 00000020:01000000:2.0:1788658554.945022:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.103@tcp (flags='') 00000020:00000080:2.0:1788658554.945036:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658554.945045:0:13324:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788658554.945079:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e56c56c19c0) has no exports 00000020:00000080:1.0:1788658554.945147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d00a4800/88ab4306-42c5-43ae-b202-256d86278024 for MGC192.168.202.103@tcp 10000000:01000000:3.0:1788658554.945530:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788658554.946555:0:13324:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.103@tcp: client import never connected 00000100:00080000:2.0:1788658554.946563:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788658554.946569:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788658554.946574:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788658554.946601:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788658554.946744:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658554.946757:0:13324:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.103@tcp (uuid 88ab4306-42c5-43ae-b202-256d86278024) 00000020:01000000:2.0:1788658554.946768:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788658554.946773:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658554.946780:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788658554.946789:0:13324:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e56de8c7000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1788658554.946908:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56d00a5000 for MGC192.168.202.103@tcp 00000020:00000080:1.0:1788658554.946920:0:36:0:(genops.c:885:class_export_put()) final put ffff9e56d00a2800/88ab4306-42c5-43ae-b202-256d86278024 00000020:00000080:1.0:1788658554.946924:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d00a2800/88ab4306-42c5-43ae-b202-256d86278024 for MGC192.168.202.103@tcp 00000020:01000000:1.0:1788658554.946939:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.103@tcp (88ab4306-42c5-43ae-b202-256d86278024) 00000020:00080000:2.0:1788658554.947367:0:13324:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9e56c6448000) has exports, disconnecting them 00000020:00080000:2.0:1788658554.947501:0:13324:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e56de8c7000), last request at 1788658337 00000020:00000080:2.0:1788658554.947509:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea9cd 00000020:00080000:2.0:1788658554.947529:0:13324:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56de8c7000): rc 0 00000020:00000080:2.0:1788658554.947534:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56de8c7000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788658554.948613:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56de8c7000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788658554.949734:0:13324:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788658554.949743:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658554.949748:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788658554.949756:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658554.950005:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56ff629800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788658554.951938:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788658554.952208:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788658554.952324:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788658554.958287:0:8509:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9e57007ea200:8509] 2 exiting: rc = 0 00000100:00100000:3.0:1788658554.958766:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e56f461ee00:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1788658555.015126:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e56f461ec00:5821] 1 exiting: rc = 0 00000100:00100000:1.0:1788658555.015647:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016029:0:7635:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e56ff385e00:7635] 3 exiting: rc = 0 00000100:00100000:3.0:1788658555.016194:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e56f461ea00:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788658555.016282:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e56f461fc00:5824] 2 exiting: rc = 0 00000100:00100000:3.0:1788658555.016390:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e56f461f600:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1788658555.016693:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016702:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016709:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016716:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016723:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016730:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016737:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016744:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016765:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016771:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016777:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016785:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016792:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016800:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016809:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016815:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016824:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016831:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016837:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016843:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016849:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016854:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016859:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016865:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016871:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016876:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016882:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016887:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016892:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016897:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016902:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016908:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016913:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016918:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016923:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016928:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016934:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016939:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016944:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016949:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016954:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016960:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016965:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016976:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016981:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016986:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.016994:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017000:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017006:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017012:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017018:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017023:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017028:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017034:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017039:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017054:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017060:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017066:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017073:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017079:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017084:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017091:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017097:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.017103:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788658555.018654:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658555.018692:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788658555.018700:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56ff628000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788658555.018705:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff628000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788658555.018711:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788658555.018764:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56fef6c800 1 00000020:00000080:1.0:1788658555.018771:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ea972 00000020:00000080:1.0:1788658555.018779:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56fef6c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788658555.018794:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788658555.018798:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658555.018804:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658555.018808:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e56c644cd40) has no exports 00000020:00000080:3.0:1788658555.019010:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fef6c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788658555.032957:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658555.032983:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788658555.032992:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56fef6f800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788658555.032998:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fef6f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788658555.033008:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788658555.033282:0:13324:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e56fef69000 00000020:01000000:3.0:1788658555.033314:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788658555.033320:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658555.033326:0:13324:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658555.033331:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e56fb3b99c0) has no exports 00000020:00000080:3.0:1788658555.033484:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658555.033493:0:13324:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788658555.033497:0:13324:0:(genops.c:885:class_export_put()) final put ffff9e56c6aeb800/OSS_uuid 00000020:00000080:3.0:1788658555.033500:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c6aeb800/OSS_uuid for OSS 00000020:01000000:3.0:1788658555.033505:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788658555.033595:0:10289:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e57008e0a00:10289] 3 exiting: rc = 0 00000100:00100000:3.0:1788658555.033753:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e56c58a9000:6686] 1 exiting: rc = 0 00000100:00100000:1.0:1788658555.038860:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e56c59ae600:6687] 2 exiting: rc = 0 00000100:00080000:1.0:1788658555.039000:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788658555.041422:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e56c58a8600:6685] 0 exiting: rc = 1 00000100:00100000:3.0:1788658555.041741:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041759:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041768:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041775:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041782:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041787:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041793:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041799:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041805:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041811:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041816:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041822:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041828:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041835:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041841:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041846:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041865:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041870:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041876:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041881:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041887:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041893:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041898:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041904:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041909:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041916:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041922:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041928:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041934:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041941:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041946:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041952:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041958:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041964:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041970:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041976:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041982:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041988:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041993:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.041998:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042004:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042009:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042015:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042022:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042027:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042033:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042052:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042059:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042065:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042071:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042077:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042089:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042095:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042100:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042106:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042112:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042118:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042124:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042131:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042137:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042143:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042151:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042157:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.042162:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043173:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e5700d12800:6689] 1 exiting: rc = 0 00000100:00100000:1.0:1788658555.043374:0:12778:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9e57008e0c00:12778] 2 exiting: rc = 0 00000100:00100000:1.0:1788658555.043788:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e56c944b000:6688] 0 exiting: rc = 1 00000100:00100000:3.0:1788658555.043903:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043928:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043935:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043942:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043948:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043953:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043960:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043966:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043973:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043979:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043986:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043992:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.043997:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044004:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044011:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044017:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044023:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044028:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044034:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044051:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044058:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044077:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044083:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044089:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044096:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044102:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044108:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044114:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044120:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044126:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044133:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044139:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044145:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044152:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044158:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044165:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044172:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044178:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044184:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044189:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044196:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044202:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044208:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044214:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044220:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044226:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044234:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044240:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044250:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044261:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044267:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044273:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044279:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044286:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044292:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044298:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044310:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044316:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044321:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044327:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044332:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044338:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044344:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.044363:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658555.045459:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e56e3146c00:6690] 0 exiting: rc = 1 00000100:00100000:1.0:1788658555.045788:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e56e3147e00:6691] 1 exiting: rc = 0 00000100:00100000:3.0:1788658555.046228:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e56e3147600:6692] 2 exiting: rc = 0 00000100:00100000:1.0:1788658555.046715:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046726:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046733:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046740:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046748:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046754:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046762:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046768:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046776:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046782:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046926:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046935:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046942:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046949:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046956:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046963:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046986:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046994:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.046999:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047006:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047014:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047021:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047027:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047034:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047054:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047063:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047069:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047075:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047081:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047087:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047109:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047117:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047125:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047132:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047138:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047144:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047151:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047159:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047167:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047174:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047197:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047206:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047213:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047219:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047226:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047233:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047240:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047248:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047254:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047261:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047268:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047275:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047281:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047288:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047295:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047300:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047306:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047313:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047319:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047325:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047333:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047340:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047562:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.047574:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658555.054801:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e56c2db3c00:6693] 0 exiting: rc = 1 00000100:00100000:3.0:1788658555.057514:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e56c2db2400:6694] 1 exiting: rc = 0 00000100:00100000:1.0:1788658555.058019:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058056:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058062:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058068:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058074:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058080:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058087:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058093:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058099:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058104:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058111:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058117:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058122:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058128:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058134:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058140:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058145:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058151:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058157:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058162:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058168:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058173:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058179:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058185:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058191:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058197:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058203:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058208:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058214:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058220:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058226:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058232:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058238:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058244:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058250:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058256:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058270:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058275:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058281:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058286:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058291:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058296:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058301:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058306:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058311:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058317:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058323:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058329:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058334:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058339:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058357:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058365:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058371:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058377:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058382:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058389:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058395:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058401:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058408:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058415:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058420:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058425:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058431:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.058438:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059373:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e56c6adb400:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1788658555.059588:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e56c6ada800:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1788658555.059726:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059734:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059741:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059747:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059755:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059771:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059893:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059900:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059907:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059915:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059922:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059929:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059936:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059944:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059951:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059961:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059969:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059991:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.059999:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060006:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060013:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060020:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060027:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060033:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060051:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060059:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060066:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060073:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060080:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060100:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060108:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060114:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060121:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060129:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060136:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060142:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060148:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060156:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060162:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060169:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060179:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060205:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060212:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060219:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060225:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060232:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060238:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060244:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060251:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060257:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060264:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060270:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060276:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060295:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060303:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060309:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060315:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060322:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060328:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060334:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060340:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060346:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060354:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658555.060360:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788658555.075563:0:13324:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788658573.095179:0:13940:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788658582.679937:0:14401:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788658582.679943:0:14401:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788658582.680067:0:14401:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e56d00a1000 00000020:01000004:2.0:1788658582.680092:0:14401:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788658582.680099:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788658582.680113:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e56c83e0000) 00000020:00000080:2.0:1788658582.680133:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788658582.701345:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788658582.704538:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788658582.705268:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 427: rc = 0 00100000:10000000:3.0:1788658582.705591:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788658582.705693:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 427: rc = 0 00100000:10000000:3.0:1788658582.705977:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 427: rc = 0 00100000:10000000:3.0:1788658582.706233:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 427: rc = 0 00100000:10000000:3.0:1788658582.706334:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 427: rc = 0 00100000:10000000:3.0:1788658582.706507:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 427: rc = 0 00100000:10000000:3.0:1788658582.707176:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 429: rc = 0 00100000:10000000:3.0:1788658582.709625:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:3.0:1788658582.709766:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:3.0:1788658582.710656:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658582.711512:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 773: rc = 0 00100000:10000000:3.0:1788658582.711970:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 773: rc = 0 00100000:10000000:3.0:1788658582.712352:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658582.712771:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658582.713305:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:3.0:1788658582.713637:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 773: rc = 0 00100000:10000000:3.0:1788658582.714220:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658582.714553:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658582.715164:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:3.0:1788658582.715405:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:3.0:1788658582.715758:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658582.716616:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 659: rc = 0 00100000:10000000:3.0:1788658582.717263:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 659: rc = 0 00100000:10000000:3.0:1788658582.717605:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 659: rc = 0 00100000:10000000:3.0:1788658582.718242:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 659: rc = 0 00100000:10000000:3.0:1788658582.718575:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 659: rc = 0 00100000:10000000:3.0:1788658582.719250:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 659: rc = 0 00100000:10000000:3.0:1788658582.719582:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 659: rc = 0 00100000:10000000:3.0:1788658582.720213:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 659: rc = 0 00100000:10000000:3.0:1788658582.720537:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 659: rc = 0 00100000:10000000:3.0:1788658582.720955:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 659: rc = 0 00100000:10000000:3.0:1788658582.721392:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 659: rc = 0 00100000:10000000:3.0:1788658582.721760:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 659: rc = 0 00100000:10000000:3.0:1788658582.722291:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 659: rc = 0 00100000:10000000:3.0:1788658582.722633:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 659: rc = 0 00100000:10000000:3.0:1788658582.723315:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 659: rc = 0 00100000:10000000:3.0:1788658582.723649:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 659: rc = 0 00100000:10000000:3.0:1788658582.724268:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 659: rc = 0 00100000:10000000:3.0:1788658582.724599:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 659: rc = 0 00100000:10000000:3.0:1788658582.725208:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 659: rc = 0 00100000:10000000:3.0:1788658582.725550:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 659: rc = 0 00100000:10000000:3.0:1788658582.726213:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 659: rc = 0 00100000:10000000:3.0:1788658582.726475:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 659: rc = 0 00100000:10000000:3.0:1788658582.726764:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 659: rc = 0 00100000:10000000:3.0:1788658582.727548:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 659: rc = 0 00100000:10000000:3.0:1788658582.728155:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 659: rc = 0 00100000:10000000:3.0:1788658582.728411:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 659: rc = 0 00100000:10000000:3.0:1788658582.728897:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 659: rc = 0 00100000:10000000:3.0:1788658582.729393:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 659: rc = 0 00100000:10000000:3.0:1788658582.729742:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 659: rc = 0 00100000:10000000:3.0:1788658582.730318:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 659: rc = 0 00100000:10000000:3.0:1788658582.730651:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 659: rc = 0 00100000:10000000:3.0:1788658582.731310:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 659: rc = 0 00100000:10000000:3.0:1788658582.732221:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 649: rc = 0 00100000:10000000:2.0:1788658582.733769:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788658582.734309:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1788658582.734577:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788658582.734650:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1788658582.735264:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788658582.735334:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:2.0:1788658582.735962:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788658582.736339:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:2.0:1788658582.736630:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788658582.736738:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1788658582.737551:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788658582.737632:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00000020:00000080:2.0:1788658582.738281:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788658582.738289:0:14401:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788658582.738299:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650eba97 00000020:01000004:2.0:1788658582.738307:0:14401:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788658582.738312:0:14401:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788658582.738317:0:14401:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56d00a1000 from MGS 00000020:01000004:2.0:1788658582.738322:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788658582.738332:0:14401:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e56c83e19c0) 00000020:00000080:2.0:1788658582.738341:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788658582.738391:0:14401:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56d00a1000 from MGS, refs=2 00080000:01000000:2.0:1788658582.738396:0:14401:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658582.738400:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ebaa5 00000100:00100000:2.0:1788658582.738577:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788658582.738746:0:14401:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788658582.738753:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788658582.740268:0:14401:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788658582.740279:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788658582.740981:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658582.741300:0:14401:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788658582.741304:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788658582.741778:0:14401:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788658582.741783:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788658582.742505:0:14401:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788658582.742514:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788658582.743575:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658582.743580:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658582.743583:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658582.743843:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658582.743844:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658582.743846:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658582.744417:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788658582.750191:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788658582.758289:0:14401:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788658582.758309:0:14401:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788658582.758312:0:14401:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788658582.762066:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788658582.762791:0:14401:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788658582.763327:0:14401:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788658582.765403:0:14401:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788658582.767253:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658582.768763:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788658582.768776:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788658582.770549:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788658582.770564:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788658582.771644:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788658582.771654:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788658582.773757:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788658582.773781:0:14401:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.103@tcp' 00000020:01000004:2.0:1788658582.773783:0:14401:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788658582.773814:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.103@tcp (typ=mgc) 00000020:00000080:2.0:1788658582.773838:0:14401:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.103@tcp (ffff9e56c83e4d40) 00000020:00000080:2.0:1788658582.773853:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788658582.773937:0:14401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56e33b3800@MGC192.168.202.103@tcp: add connection 192.168.202.103@tcp at head 00000100:00080000:3.0:1788658582.774577:0:14415:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1788658582.775579:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.103@tcp-0 is initialized 00000040:01000000:2.0:1788658582.775589:0:14401:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788658582.776693:0:14416:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788658582.777149:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.103@tcp (uuid 7221c739-be00-4743-a572-f61de58b82dc) 00000020:00000080:3.0:1788658582.777179:0:14401:0:(genops.c:1385:class_connect()) connect: client 7221c739-be00-4743-a572-f61de58b82dc, cookie 0xf657f176650ebab3 00000100:00080000:3.0:1788658582.777196:0:14401:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658582.777204:0:14401:0:(import.c:665:import_select_connection()) MGC192.168.202.103@tcp: import ffff9e56e33b3800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658582.777240:0:14401:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefd8380 x1875544103800320/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658582.777282:0:14401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7221c739-be00-4743-a572-f61de58b82dc->MGS 00000020:01000004:3.0:1788658582.777315:0:14401:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788658582.777320:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788658582.777335:0:14401:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e56fb3b99c0) 00000020:00000080:3.0:1788658582.777347:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788658582.777557:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7221c739-be00-4743-a572-f61de58b82dc:3303:1875544103800320:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788658582.777633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658582.777728:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103800320 00000100:00100000:2.0:1788658582.777735:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103800320 00000100:00100000:2.0:1788658582.777768:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658582.777776:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875544103800320:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788658582.777798:0:14412:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7221c739-be00-4743-a572-f61de58b82dc@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1788658582.777820:0:14412:0:(genops.c:1385:class_connect()) connect: client 7221c739-be00-4743-a572-f61de58b82dc, cookie 0xf657f176650ebac1 00000100:00080000:2.0:1788658582.777971:0:14412:0:(import.c:65:import_set_state_nolock()) ffff9e56d16af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658582.778035:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+5:3303:x1875544103800320:12345-0@lo:250:mount.lustre.0 Request processed in 258us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658582.778044:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658582.778095:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788658582.778103:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.103@tcp: connect to target with instance 0 00000100:00080000:2.0:1788658582.778110:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788658582.778114:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788658582.778117:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56e33b3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788658582.778119:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788658582.778126:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788658582.778152:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7221c739-be00-4743-a572-f61de58b82dc:3303:1875544103800320:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788658582.803740:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658582.804260:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788658582.804269:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788658582.814314:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788658582.814329:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788658582.815295:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658582.815304:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788658582.816327:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658582.816605:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788658582.816612:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788658582.817643:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788658582.817654:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788658582.858918:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658582.861401:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788658582.861410:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788658582.868874:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788658582.868890:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788658582.869945:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658582.870369:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788658582.870376:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788658582.872215:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788658582.872229:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788658582.873287:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658582.873799:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788658582.873808:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788658582.877583:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788658582.877596:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788658582.878433:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658582.878636:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788658582.878641:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788658582.879713:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788658582.879722:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788658582.914311:0:14401:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658582.914626:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658582.914635:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788658582.917117:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658582.917130:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788658582.918300:0:14401:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658582.918310:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788658582.919755:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788658582.919781:0:14401:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788658582.919787:0:14401:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788658582.920188:0:14401:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658582.920238:0:14401:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788658582.920243:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658582.920245:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658582.920246:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658582.920247:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658582.920249:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658582.920250:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658582.920252:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658582.920253:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658582.920255:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658582.920256:0:14401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658582.920259:0:14401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788658582.920261:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658582.920262:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658582.920263:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658582.920265:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658582.920266:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658582.920267:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658582.920272:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658582.920272:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658582.920273:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658582.920274:0:14401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658582.920302:0:14401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788658582.920323:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658582.920408:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658582.920578:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c20a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658582.920811:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103800448 00000100:00100000:1.0:1788658582.920819:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103800448 00000100:00100000:1.0:1788658582.920905:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658582.920925:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+5:14401:x1875544103800448:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658582.920971:0:14414:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788658582.920978:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788658582.920981:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788658582.921425:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788658582.921850:0:14414:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788658582.924248:0:14435:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788658582.924255:0:14435:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788658582.924257:0:14435:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788658582.924295:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788658582.924742:0:14414:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788658582.924753:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788658582.930935:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+5:14401:x1875544103800448:12345-0@lo:253:mount.lustre.0 Request processed in 10011us (10517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658582.930966:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658582.931354:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658582.931371:0:14401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788658582.931374:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658582.931376:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658582.931378:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658582.931379:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658582.931380:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658582.931382:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658582.931384:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658582.931385:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658582.931387:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658582.931389:0:14401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658582.931411:0:14401:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56d00a1000 from lustre-MDT0000 10000000:01000000:2.0:1788658582.931445:0:14401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788658582.931448:0:14401:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788658582.931453:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e56c83e4d40 10000000:01000000:2.0:1788658582.931458:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658582.931468:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e56c83e4d40 from 1 10000000:01000000:2.0:1788658582.931471:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788658582.931517:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658582.931529:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658582.931539:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658582.931574:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658582.931616:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658582.931844:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c20f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658582.932345:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103800576 00000100:00100000:3.0:1788658582.932364:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103800576 00000100:00100000:3.0:1788658582.932454:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658582.932464:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+5:14401:x1875544103800576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658582.932478:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658582.932497:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007eee00/0xf657f176650ebacf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebac8 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658582.932523:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007eee00/0xf657f176650ebacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebac8 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658582.932534:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007eee00/0xf657f176650ebacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebac8 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658582.932542:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eee00, rc 0) 00000100:00100000:3.0:1788658582.932595:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+6:14401:x1875544103800576:12345-0@lo:101:mount.lustre.0 Request processed in 133us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658582.932601:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658582.932696:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658582.932722:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.932731:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658582.932789:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658582.932822:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658582.932980:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658582.933282:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103800704 00000100:00100000:2.0:1788658582.933288:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103800704 00000100:00100000:2.0:1788658582.933315:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658582.933322:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+6:14401:x1875544103800704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658582.933585:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+6:14401:x1875544103800704:12345-0@lo:501:mount.lustre.0 Request processed in 260us (760us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658582.933592:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658582.933699:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800704:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788658582.933733:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788658582.933755:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.933764:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658582.933773:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56d00a1000 10000000:01000000:0.0:1788658582.933778:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788658582.933783:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e56d00a1000 10000000:01000000:0.0:1788658582.933785:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788658582.933788:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e56d00a1000 from 1 10000000:01000000:0.0:1788658582.933791:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788658582.933818:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.933826:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.933846:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658582.933860:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658582.933889:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658582.933927:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658582.934349:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103800832 00000100:00100000:1.0:1788658582.934355:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103800832 00000100:00100000:1.0:1788658582.934380:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658582.934388:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fef87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+6:14401:x1875544103800832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658582.934397:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658582.934409:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1679a00/0xf657f176650ebadd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebad6 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658582.934429:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1679a00/0xf657f176650ebadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebad6 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658582.934441:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1679a00/0xf657f176650ebadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebad6 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658582.934450:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679a00, rc 0) 00000100:00100000:1.0:1788658582.934496:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fef87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+7:14401:x1875544103800832:12345-0@lo:101:mount.lustre.0 Request processed in 109us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658582.934503:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658582.934581:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658582.934594:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.934603:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658582.934615:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788658582.934630:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.934638:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658582.934645:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788658582.934649:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658582.934654:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e56d00a1000 10000000:01000000:0.0:1788658582.934657:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788658582.934660:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788658582.934662:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788658582.934716:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.934733:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.934740:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658582.934755:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658582.934784:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658582.934805:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658582.935202:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103800960 00000100:00100000:1.0:1788658582.935209:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103800960 00000100:00100000:1.0:1788658582.935234:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658582.935241:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fef87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+7:14401:x1875544103800960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658582.935249:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658582.935259:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1679200/0xf657f176650ebaeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebae4 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658582.935288:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1679200/0xf657f176650ebaeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebae4 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658582.935296:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1679200/0xf657f176650ebaeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebae4 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658582.935303:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679200, rc 0) 00000100:00100000:1.0:1788658582.935343:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fef87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+8:14401:x1875544103800960:12345-0@lo:101:mount.lustre.0 Request processed in 101us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658582.935349:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658582.935424:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103800960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658582.935436:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658582.935443:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658582.935485:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658582.935512:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658582.935576:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658582.935649:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103801088 00000100:00100000:3.0:1788658582.935654:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103801088 00000100:00100000:1.0:1788658582.935808:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658582.935816:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fef84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+8:14401:x1875544103801088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658582.936249:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fef84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+9:14401:x1875544103801088:12345-0@lo:501:mount.lustre.0 Request processed in 434us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658582.936257:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658582.936388:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658582.936418:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658582.936454:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658582.936482:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658582.936642:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103801216 00000100:00100000:1.0:1788658582.936648:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103801216 00000100:00100000:1.0:1788658582.936686:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658582.936693:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+9:14401:x1875544103801216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658582.937272:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+9:14401:x1875544103801216:12345-0@lo:503:mount.lustre.0 Request processed in 577us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658582.937280:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658582.937712:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658582.938611:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14436:1875544103801344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658582.938711:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658582.938746:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658582.938821:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103801344 00000100:00100000:3.0:1788658582.938828:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103801344 00000100:00100000:3.0:1788658582.939311:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658582.939323:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+9:14436:x1875544103801344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658582.939653:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+9:14436:x1875544103801344:12345-0@lo:502:llog_process_th.0 Request processed in 331us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658582.939661:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658582.939800:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14436:1875544103801344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658582.939834:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658582.939849:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658582.939851:0:14436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788658582.939859:0:14436:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788658582.939862:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658582.939879:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e56c89119c0) 00000020:00000080:0.0:1788658582.939896:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788658582.939902:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788658582.939993:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788658582.943793:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ebaf9 00000020:00000080:0.0:1788658582.944371:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788658582.944382:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658582.944389:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658582.944391:0:14436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788658582.944393:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658582.944399:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658582.944400:0:14436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788658582.944404:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658582.944417:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e56c8914d40) 00000020:00000080:0.0:1788658582.944433:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788658582.944437:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788658582.944439:0:14436:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788658582.944442:0:14436:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788658582.944448:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788658582.944502:0:14436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56d00a1000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788658582.944515:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e56c8913380) 00000020:00000080:0.0:1788658582.944522:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788658582.944567:0:14436:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788658582.944588:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ebb0e 00000020:00000080:0.0:1788658582.944788:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788658582.944795:0:14436:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788658582.944799:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf657f176650ebb15 00080000:01000000:0.0:1788658582.944805:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788658582.944808:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ebb1c 00010000:00010000:3.0:1788658583.050407:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788658583.052241:0:14436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1788658583.053320:0:14436:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788658583.055014:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e56c83e3380) 00000020:00000080:2.0:1788658583.055036:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788658583.055113:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788658583.055121:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ebb2a 00000020:00000080:3.0:1788658583.056733:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788658583.068460:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf657f176650ebb31 00000020:00000080:0.0:1788658583.068820:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788658583.068831:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658583.068838:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.068840:0:14436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788658583.068844:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658583.068850:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.068851:0:14436:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788658583.068856:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788658583.068889:0:14436:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788658583.068900:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658583.068903:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.068905:0:14436:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788658583.068908:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788658583.068910:0:14436:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1788658583.068912:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658583.068914:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658583.068915:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788658583.068918:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.068919:0:14436:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788658583.068922:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788658583.068925:0:14436:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788658583.068928:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.068929:0:14436:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788658583.068932:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788658583.068938:0:14436:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:0.0:1788658583.068964:0:14436:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788658583.068968:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658583.068987:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e56c8910000) 00000020:00000080:0.0:1788658583.069000:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788658583.069107:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788658583.069197:0:14436:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788658583.069203:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788658583.069214:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ebb3f 00010000:00080000:0.0:1788658583.069247:0:14436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5700dc6800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:0.0:1788658583.069464:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788658583.072140:0:14436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788658583.072208:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788658583.073991:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658583.074619:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788658583.075071:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788658583.076066:0:14440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788658583.076071:0:14440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788658583.076897:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658583.076910:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788658583.076953:0:14436:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788658583.076974:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ebb46 00000100:00080000:0.0:1788658583.076987:0:14436:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658583.076993:0:14436:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5700dc6800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1788658583.077173:0:14436:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56ff644700 x1875544103801472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658583.077197:0:14436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788658583.077256:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658583.077260:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.077262:0:14436:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788658583.077265:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788658583.077268:0:14436:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788658583.077270:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658583.077271:0:14436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658583.077273:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788658583.077275:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.077284:0:14436:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788658583.077287:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788658583.077291:0:14436:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788658583.077294:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658583.077296:0:14436:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788658583.077298:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788658583.077302:0:14436:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:0.0:1788658583.077325:0:14436:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788658583.077327:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658583.077347:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e56e6ee19c0) 00000020:00000080:0.0:1788658583.077360:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788658583.077365:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788658583.077422:0:14436:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788658583.077429:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788658583.077434:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ebb54 00010000:00080000:0.0:1788658583.077472:0:14436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56d183a000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:0.0:1788658583.077779:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788658583.078226:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103801472:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788658583.078280:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103801472 offset 0 length 520: 4 00000040:01000000:0.0:1788658583.078443:0:14436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788658583.078467:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788658583.079903:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658583.079992:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788658583.082413:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788658583.084627:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788658583.084636:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788658583.085376:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658583.085389:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788658583.085419:0:14436:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788658583.085436:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ebb5b 00000100:00080000:2.0:1788658583.085446:0:14436:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658583.085452:0:14436:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183a000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658583.085487:0:14436:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e55c2403100 x1875544103801600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658583.086753:0:14436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788658583.086838:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658583.086844:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658583.086845:0:14436:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788658583.086849:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658583.086853:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658583.086855:0:14436:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658583.086857:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658583.086859:0:14436:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658583.086861:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658583.086863:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658583.086864:0:14436:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658583.086867:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658583.086869:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658583.086870:0:14436:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658583.086874:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788658583.086914:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14436:1875544103801728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658583.086993:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658583.087140:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103801600:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788658583.087182:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103801600 offset 0 length 520: 4 00000100:00100000:2.0:1788658583.087800:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9624840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658583.096539:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103801728 00000100:00100000:2.0:1788658583.096554:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103801728 00000100:00100000:2.0:1788658583.096655:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658583.096699:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+9:14436:x1875544103801728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658583.097415:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+9:14436:x1875544103801728:12345-0@lo:502:llog_process_th.0 Request processed in 749us (10420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658583.097423:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658583.097443:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14436:1875544103801728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658583.097487:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658583.097504:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658583.097506:0:14436:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788658583.098078:0:14436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788658583.098469:0:14401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788658583.098499:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788658583.098528:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.098555:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658583.098562:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56d00a1000 from 1 10000000:01000000:1.0:1788658583.098565:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658583.098600:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.098607:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.098616:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658583.098639:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788658583.098713:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.106785:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658583.110675:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103801856 00000100:00100000:0.0:1788658583.110692:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103801856 00000100:00100000:0.0:1788658583.110761:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788658583.110772:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb261450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+9:14401:x1875544103801856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658583.110808:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658583.110831:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebb62 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.110861:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebb62 expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.110874:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebb62 expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.110884:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79000, rc 0) 00000100:00100000:1.0:1788658583.111995:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658583.112018:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.112030:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658583.112726:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801984:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788658583.113599:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb261450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+10:14401:x1875544103801856:12345-0@lo:101:mount.lustre.0 Request processed in 2822us (14878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658583.113610:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658583.113662:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658583.113711:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103801984 00000100:00100000:1.0:1788658583.113712:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658583.113717:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103801984 00000100:00100000:0.0:1788658583.113747:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658583.113754:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+10:14401:x1875544103801984:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788658583.113772:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788658583.113778:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788658583.113857:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+10:14401:x1875544103801984:12345-0@lo:256:mount.lustre.0 Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658583.113864:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658583.113943:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103801984:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788658583.114586:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658583.114611:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.114623:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658583.114632:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56d00a1000 from 1 10000000:01000000:1.0:1788658583.114635:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658583.114713:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.114723:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.114733:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658583.114754:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788658583.114793:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.114808:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658583.115310:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103802112 00000100:00100000:0.0:1788658583.115318:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103802112 00000100:00100000:0.0:1788658583.115349:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658583.115357:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+10:14401:x1875544103802112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658583.115368:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658583.115474:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebb70 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.115506:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebb70 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.115518:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebb70 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.115527:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658583.115575:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+11:14401:x1875544103802112:12345-0@lo:101:mount.lustre.0 Request processed in 219us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658583.115582:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658583.116440:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658583.116471:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.116482:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658583.116582:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658583.116621:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.116677:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658583.117049:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103802240 00000100:00100000:3.0:1788658583.117056:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103802240 00000100:00100000:2.0:1788658583.117195:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658583.117207:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+11:14401:x1875544103802240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658583.117731:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+11:14401:x1875544103802240:12345-0@lo:501:mount.lustre.0 Request processed in 525us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658583.119650:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658583.119756:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658583.119834:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.119885:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658583.120080:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103802368 00000100:00100000:3.0:1788658583.120088:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103802368 00000100:00100000:2.0:1788658583.121232:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658583.126815:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658583.126851:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+11:14401:x1875544103802368:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658583.128064:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+11:14401:x1875544103802368:12345-0@lo:503:mount.lustre.0 Request processed in 1231us (8226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658583.128076:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658583.128439:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658583.129207:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14444:1875544103802496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658583.129267:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.129312:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658583.129983:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103802496 00000100:00100000:2.0:1788658583.129992:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103802496 00000100:00100000:2.0:1788658583.130053:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658583.130063:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+11:14444:x1875544103802496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658583.130324:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+11:14444:x1875544103802496:12345-0@lo:502:llog_process_th.0 Request processed in 262us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658583.130332:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658583.130692:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14444:1875544103802496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658583.130723:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658583.130733:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658583.130735:0:14444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658583.130742:0:14444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56d00a1000 00000020:00000080:1.0:1788658583.130745:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658583.130752:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658583.130755:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658583.130756:0:14444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658583.130759:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658583.130761:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658583.130762:0:14444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658583.130765:0:14444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56d00a1000 00000020:00000080:1.0:1788658583.130767:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658583.130828:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658583.130831:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658583.130833:0:14444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658583.130835:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658583.130838:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658583.130839:0:14444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658583.131733:0:14444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56d00a1000 00000020:00000080:1.0:1788658583.131736:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788658583.131794:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14444:1875544103802624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658583.132176:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.132285:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658583.141079:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103802624 00000100:00100000:0.0:1788658583.141175:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103802624 00000100:00100000:0.0:1788658583.141238:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658583.141249:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+11:14444:x1875544103802624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658583.144228:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+11:14444:x1875544103802624:12345-0@lo:502:llog_process_th.0 Request processed in 2850us (11921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658583.144243:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658583.144632:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14444:1875544103802624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658583.144695:0:14444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658583.144703:0:14444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658583.144706:0:14444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788658583.144710:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788658583.145709:0:14401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788658583.145734:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658583.145759:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.145773:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658583.145826:0:14401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788658583.145838:0:14401:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56d00a1000 10000000:01000000:0.0:1788658583.145912:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56d00a1000 10000000:01000000:0.0:1788658583.145919:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658583.145996:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56d00a1000 from 1 10000000:01000000:0.0:1788658583.145999:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658583.146039:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.146048:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.146058:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658583.146081:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658583.146710:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658583.157976:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103802752 00000100:00100000:2.0:1788658583.157991:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103802752 00000100:00100000:2.0:1788658583.158049:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788658583.158060:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+11:14401:x1875544103802752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658583.158077:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658583.158099:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891bc00/0xf657f176650ebb85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebb7e expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658583.158125:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891bc00/0xf657f176650ebb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebb7e expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658583.158137:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891bc00/0xf657f176650ebb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebb7e expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658583.158179:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891bc00, rc 0) 00000100:00100000:2.0:1788658583.158242:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14401:x1875544103802752:12345-0@lo:101:mount.lustre.0 Request processed in 183us (11532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658583.158249:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658583.170002:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f44b8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658583.170054:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658583.170082:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658583.170238:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658583.170337:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658583.170400:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.170441:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d80b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658583.171062:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103802880 00000100:00100000:1.0:1788658583.171072:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103802880 00000100:00100000:1.0:1788658583.171206:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658583.171216:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14401:x1875544103802880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658583.173251:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14401:x1875544103802880:12345-0@lo:501:mount.lustre.0 Request processed in 2029us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658583.173264:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658583.173346:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103802880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658583.173397:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103803008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658583.173442:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658583.173745:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803008 00000100:00100000:2.0:1788658583.173752:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803008 00000100:00100000:2.0:1788658583.173796:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658583.173804:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14401:x1875544103803008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658583.176046:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658583.177369:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14401:x1875544103803008:12345-0@lo:503:mount.lustre.0 Request processed in 3558us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658583.177385:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658583.178279:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103803008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658583.181645:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14449:1875544103803136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658583.181767:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.181811:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803136 00000100:00100000:1.0:1788658583.181818:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803136 00000100:00100000:1.0:1788658583.183577:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658583.183596:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14449:x1875544103803136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658583.183915:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14449:x1875544103803136:12345-0@lo:502:llog_process_th.0 Request processed in 325us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658583.185259:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658583.185336:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658583.185365:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14449:1875544103803136:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788658583.185436:0:14449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788658583.185466:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e56c6448000) 00000020:00000080:1.0:1788658583.185488:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788658583.185612:0:14449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56d00a1000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788658583.185617:0:14449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56d00a1000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788658583.185620:0:14449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56d00a1000 4 00010000:00080000:1.0:1788658583.185652:0:14449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56c37f5800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:1.0:1788658583.187382:0:14449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788658583.190891:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788658583.190953:0:14449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788658583.190969:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf657f176650ebb93 00000100:00080000:1.0:1788658583.190982:0:14449:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658583.190989:0:14449:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e56c37f5800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658583.191026:0:14449:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5700568a80 x1875544103803264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658583.191066:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103803264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658583.191296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788658583.191367:0:14449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788658583.191571:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803264 00000100:00100000:3.0:1788658583.191580:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803264 00000100:00100000:3.0:1788658583.191623:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658583.191631:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103803264:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788658583.191721:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103803264:12345-0@lo:38:llog_process_th.0 Request processed in 88us (425us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788658583.191730:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658583.191769:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658583.191778:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56c37f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658583.191784:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788658583.191788:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103803264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658583.192105:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14449:1875544103803392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658583.192170:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.192197:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803392 00000100:00100000:1.0:1788658583.192202:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803392 00000100:00100000:1.0:1788658583.192244:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658583.192251:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14449:x1875544103803392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658583.192502:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14449:x1875544103803392:12345-0@lo:502:llog_process_th.0 Request processed in 251us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658583.192509:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658583.193578:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba180 going to sleep for 11 seconds 00000100:00100000:1.0:1788658583.193607:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7221c739-be00-4743-a572-f61de58b82dc:14449:1875544103803392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788658583.193639:0:14449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788658583.194395:0:14401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788658583.194423:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658583.194452:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658583.194464:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658583.194515:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658583.194517:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658583.194518:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658583.194520:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658583.194521:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658583.194522:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658583.194523:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658583.194525:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658583.194526:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658583.194528:0:14401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658583.194536:0:14401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788658583.194539:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658583.194540:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658583.194541:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658583.194542:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658583.194543:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658583.194544:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658583.194544:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658583.194545:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658583.194546:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658583.194547:0:14401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658583.194569:0:14401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788658583.194585:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103803520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658583.194657:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658583.194707:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803520 00000100:00100000:0.0:1788658583.194714:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803520 00000100:00100000:2.0:1788658583.194725:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8817e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658583.194752:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658583.194759:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14401:x1875544103803520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658583.194779:0:14412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788658583.194791:0:14412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788658583.234556:0:14412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788658583.234576:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788658583.234631:0:14434:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788658583.234637:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788658583.234660:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.234732:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebb62 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.234741:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.234783:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ebb62 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.234796:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ebb62 expref: 12 pid: 14414 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658583.234811:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875544103803648:0@lo:104: 00000100:00100000:3.0:1788658583.234876:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658583.234914:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff3e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658583.235189:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803648 00000100:00100000:0.0:1788658583.235203:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803648 00000100:00100000:0.0:1788658583.235257:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658583.235266:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7221c739-be00-4743-a572-f61de58b82dc+3:14434:x1875544103803648:12345-0@lo:104: 00010000:00010000:0.0:1788658583.235280:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.235344:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658583.235351:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7221c739-be00-4743-a572-f61de58b82dc+3:14434:x1875544103803648:12345-0@lo:104: Request processed in 86us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658583.235358:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788658583.235382:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658583.235387:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.235394:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678600 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658583.235398:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.235407:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658583.235415:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658583.235420:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658583.235449:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.235456:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788658583.236257:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875544103803648:0@lo:104: 00010000:00010000:3.0:1788658583.236279:0:14434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658583.236394:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103803776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658583.236438:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658583.236652:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803776 00000100:00100000:3.0:1788658583.236659:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803776 00010000:00010000:3.0:1788658583.236709:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebb62 expref: 13 pid: 14414 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658583.236737:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658583.236745:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+13:3304:x1875544103803776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658583.236756:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658583.236761:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebb62 expref: 13 pid: 14414 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236783:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ebb62 expref: 13 pid: 14414 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236799:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79000/0xf657f176650ebb69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ebb62 expref: 13 pid: 14414 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236814:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236821:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788658583.236834:0:14405:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002198721s 00010000:00010000:3.0:1788658583.236838:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236845:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236850:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236857:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236862:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658583.236866:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236874:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236895:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.236904:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658583.237018:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.237033:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1678600/0xf657f176650ebb62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebb69 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658583.237049:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658583.237051:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658583.237053:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658583.237321:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+12:3304:x1875544103803776:12345-0@lo:103:ldlm_bl.0 Request processed in 575us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658583.237329:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788658583.237420:0:14434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.237428:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658583.237434:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ee000/0xf657f176650ebb9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658583.237485:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103803776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658583.246183:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+11:14401:x1875544103803520:12345-0@lo:253:mount.lustre.0 Request processed in 51414us (51516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658583.246210:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658583.246315:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:14401:1875544103803520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658583.246330:0:14401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788658583.246333:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658583.246335:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658583.246336:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658583.246337:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658583.246339:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658583.246339:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658583.246341:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658583.246342:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658583.246344:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658583.246345:0:14401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788658583.246358:0:14401:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788658583.255486:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658583.255701:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658583.255991:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658583.256165:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658583.256432:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658583.256593:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788658583.260571:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658583.260781:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788658583.261291:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658583.261778:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788658583.262063:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658583.262380:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788658583.318841:0:14401:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788658583.319312:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788658583.319495:0:14455:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788658583.319499:0:14455:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788658583.319911:0:14456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788658583.319999:0:14456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658583.323794:0:14456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788658583.323877:0:14456:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788658583.323882:0:14456:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788658583.329039:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788658583.329270:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788658583.330177:0:14401:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788658583.330188:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788658583.330361:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658583.332206:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788658583.333020:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788658583.333062:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788658583.335342:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788658583.342436:0:14401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788658583.401385:0:14401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788658583.401425:0:14401:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdf2418bf988 00100000:10000000:1.0:1788658583.401434:0:14401:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788658583.402928:0:14401:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658583.402955:0:14401:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658583.402969:0:14401:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788658583.402985:0:14401:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788658583.772914:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658584.223557:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788658584.287979:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658584.287987:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56d00a1000 from 6 10000000:01000000:3.0:1788658584.287992:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658584.288051:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658584.288064:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658584.288076:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658584.288104:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103803904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658584.288182:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658584.288257:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56dea96240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658584.289138:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103803904 00000100:00100000:2.0:1788658584.289149:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103803904 00000100:00100000:2.0:1788658584.289243:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658584.289253:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+11:14416:x1875544103803904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658584.289268:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658584.289286:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebba1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658584.289314:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebba1 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658584.289326:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebba1 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658584.289335:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ba00, rc 0) 00000100:00100000:2.0:1788658584.289401:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103803904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658584.289407:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658584.290131:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103803904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658584.290153:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658584.290165:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658584.290245:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658584.290295:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658584.290339:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56dea96240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658584.290402:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804032 00000100:00100000:0.0:1788658584.290408:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804032 00000100:00100000:0.0:1788658584.290451:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658584.290459:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103804032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788658584.290474:0:14412:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658584.290505:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658584.290508:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788658584.290620:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103804032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658584.290628:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658584.290945:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788658584.291000:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658584.291008:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658584.291024:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658584.796896:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658585.249757:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788658585.820931:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658586.845580:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658587.870844:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788658588.574485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658588.574494:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658588.574497:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658588.574500:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658588.574503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788658588.574506:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788658588.574510:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56c37f5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658588.574525:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e56c37f5800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658588.574580:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e55c2401c00 x1875544103804288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658588.574622:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103804160:0@lo:400:kworker.0 00000100:00100000:2.0:1788658588.575122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658588.575282:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804160 00000100:00100000:0.0:1788658588.575293:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804160 00000100:00100000:0.0:1788658588.575353:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658588.575366:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+12:3305:x1875544103804160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658588.575485:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103804288:0@lo:38:kworker.0 00000100:00100000:0.0:1788658588.577363:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+12:3305:x1875544103804160:12345-0@lo:400:kworker.0 Request processed in 1990us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658588.577393:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658588.577479:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103804160:0@lo:400:kworker.0 00000100:00100000:2.0:1788658588.577795:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658588.578326:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804288 00000100:00100000:0.0:1788658588.578334:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804288 00000100:00100000:0.0:1788658588.578361:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658588.578368:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875544103804288:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788658588.578407:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788658588.578440:0:14420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf657f176650ebbaf 00000004:00100000:0.0:1788658588.578455:0:14420:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658588.578679:0:14420:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658588.578810:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875544103804288:12345-0@lo:38:kworker.0 Request processed in 440us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658588.578818:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788658588.578900:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e55c2401c00 x1875544103804288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658588.578916:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788658588.578923:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788658588.578928:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788658588.578931:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56c37f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658588.578936:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103804288:0@lo:38:kworker.0 00010000:00010000:1.0:1788658588.893604:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658588.910273:0:14699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788658589.919121:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658590.941252:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658591.964860:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788658592.094313:0:14850:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0fa7ca70 20000000:00000080:1.0:1788658592.094332:0:14850:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e56e6f9dc00 uarg=0000000000000000 20000000:01000000:1.0:1788658592.094366:0:14850:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788658592.094373:0:14850:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788658592.094377:0:14850:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788658592.098650:0:14851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788658592.098877:0:14850:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788658592.116869:0:14850:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788658592.118471:0:14850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658592.118498:0:14850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebb70 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658592.118508:0:14850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658592.118574:0:14850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ebb70 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658592.118590:0:14850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ebb70 expref: 11 pid: 14414 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658592.118605:0:14850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14850:1875544103804416:0@lo:104: 00000100:00100000:3.0:1788658592.120371:0:14850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658592.120463:0:14850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ca6cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658592.120488:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804416 00000100:00100000:1.0:1788658592.120497:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804416 00000100:00100000:1.0:1788658592.120579:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658592.120590:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+3:14850:x1875544103804416:12345-0@lo:104: 00010000:00010000:1.0:1788658592.120608:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658592.120725:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658592.120731:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+3:14850:x1875544103804416:12345-0@lo:104: Request processed in 144us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658592.120738:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658592.120787:0:14850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14850:1875544103804416:0@lo:104: 00010000:00010000:3.0:1788658592.120815:0:14850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.120849:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658592.120856:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.120864:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1678400 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658592.120869:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.120878:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658592.120885:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658592.120902:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658592.120948:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.120955:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658592.120990:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.120999:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1678400/0xf657f176650ebb70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebb77 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121017:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658592.121019:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658592.121020:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658592.121081:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658592.121094:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103804544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658592.121133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658592.121298:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804544 00000100:00100000:2.0:1788658592.121311:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804544 00010000:00010000:2.0:1788658592.121332:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebb70 expref: 12 pid: 14414 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658592.121368:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658592.121377:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7221c739-be00-4743-a572-f61de58b82dc+12:3307:x1875544103804544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658592.121387:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658592.121392:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebb70 expref: 12 pid: 14414 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121404:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ebb70 expref: 12 pid: 14414 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121418:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79a00/0xf657f176650ebb77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ebb70 expref: 12 pid: 14414 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121440:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121448:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121462:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121469:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121476:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121483:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121488:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658592.121492:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121500:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121520:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658592.121537:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658592.121637:0:14850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658592.121645:0:14850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658592.121652:0:14850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbb6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658592.121703:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7221c739-be00-4743-a572-f61de58b82dc+11:3307:x1875544103804544:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658592.121716:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658592.125891:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103804544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658592.990629:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788658593.182310:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658593.182322:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56d00a1000 from 10 10000000:01000000:0.0:1788658593.182329:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658593.182613:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658593.182627:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658593.182654:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658593.183973:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658593.184050:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658593.184603:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804672 00000100:00100000:2.0:1788658593.184612:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804672 00000100:00100000:2.0:1788658593.184697:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658593.184707:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+11:14416:x1875544103804672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658593.185416:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658593.185451:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebbbd expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658593.185482:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebbbd expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658593.185494:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebbbd expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658593.185504:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b800, rc 0) 00000100:00100000:0.0:1788658593.189194:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658593.190421:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103804672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5707us (6362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658593.190443:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658593.191191:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658593.191222:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658593.191237:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658593.191318:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658593.191797:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658593.191840:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658593.192657:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804800 00000100:00100000:1.0:1788658593.192703:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804800 00000100:00100000:1.0:1788658593.192772:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658593.192783:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103804800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658593.194068:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103804800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1280us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658593.194277:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658593.194337:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658593.194554:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658593.194627:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658593.194709:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658593.194848:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103804928 00000100:00100000:2.0:1788658593.194854:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103804928 00000100:00100000:2.0:1788658593.195288:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658593.195299:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103804928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658593.196328:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:14416:x1875544103804928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1026us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658593.196339:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658593.196521:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103804928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658593.198372:0:14881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788658593.198967:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788658593.199008:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658593.199021:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658593.199034:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658593.695881:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658593.695892:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658593.695913:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658593.695917:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658593.696074:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658593.696095:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103805056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658593.696168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658593.696245:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103805056 00000100:00100000:0.0:1788658593.696253:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103805056 00000100:00100000:0.0:1788658593.696298:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658593.696307:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103805056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658593.696356:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103805056:12345-0@lo:400:kworker.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658593.696363:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788658593.696476:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e56ff645c00 x1875544103805056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658593.696488:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103805056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658593.704406:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658583/real 1788658583] req@ffff9e55c2403100 x1875544103801600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658593 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658593.704437:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e55c2403100 x1875544103801600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658593 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658593.704449:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658583/real 1788658583] req@ffff9e56ff644700 x1875544103801472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658593 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658593.704462:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e56ff644700 x1875544103801472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658593 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658593.704499:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658593.704522:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788658593.704526:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103801600:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788658593.704533:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e5700dc6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658593.704538:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788658593.704541:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103801472:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788658593.705177:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658593.705183:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788658593.705187:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5700dc6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658593.705192:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1788658593.705198:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658593.705204:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5700dc6800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658593.705240:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e570056a300 x1875544103805184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658593.705258:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658593.705262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658593.705271:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658593.705275:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1788658593.705278:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658593.705282:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183a000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658593.705296:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5700568a80 x1875544103805312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658593.705325:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103805184:0@lo:8:kworker.0 00000400:00000100:1.0:1788658593.705379:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103805184 offset 0 length 520: 4 00000100:00100000:1.0:1788658593.705418:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103805312:0@lo:8:kworker.0 00000400:00000100:1.0:1788658593.705436:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103805312 offset 0 length 520: 4 00010000:00010000:0.0:1788658594.016246:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658595.039604:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658595.491842:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788658596.063017:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658597.086117:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658598.116269:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658598.402706:0:15098:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788658598.402712:0:15098:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788658598.402847:0:15098:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e56e5c8d800 00000020:01000004:3.0:1788658598.402863:0:15098:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788658598.402876:0:15098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788658598.402890:0:15098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e56fb3b8000) 00000020:00000080:3.0:1788658598.402906:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788658598.431471:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788658598.432323:0:15098:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788658598.435190:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788658598.435421:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788658598.435622:0:15098:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788658598.443968:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788658598.444080:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788658598.444208:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788658598.444773:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 111: rc = 0 00100000:10000000:2.0:1788658598.445041:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 111: rc = 0 00100000:10000000:2.0:1788658598.445343:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 111: rc = 0 00100000:10000000:2.0:1788658598.445585:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 111: rc = 0 00100000:10000000:2.0:1788658598.445882:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 111: rc = 0 00100000:10000000:2.0:1788658598.446120:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 111: rc = 0 00000020:00000080:2.0:1788658598.446708:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788658598.446720:0:15098:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788658598.446730:0:15098:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf657f176650ebbd2 00000020:01000004:2.0:1788658598.446738:0:15098:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788658598.446757:0:15098:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788658598.446760:0:15098:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788658598.446765:0:15098:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788658598.446770:0:15098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788658598.446782:0:15098:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e56c56c19c0) 00000020:00000080:2.0:1788658598.457551:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788658598.463482:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658598.463725:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658598.463733:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788658598.467691:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788658598.467709:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788658598.468914:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658598.468924:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788658598.470753:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658598.471016:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788658598.471022:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788658598.472498:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788658598.472507:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788658598.504505:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658598.504848:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788658598.504855:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788658598.506201:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788658598.506214:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788658598.507053:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788658598.507062:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788658598.509995:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658598.510445:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788658598.510453:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788658598.516476:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788658598.516508:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788658598.571443:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658598.571824:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788658598.571831:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788658598.573076:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788658598.573096:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788658598.573515:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788658598.573546:0:15098:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788658598.573551:0:15098:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788658598.579933:0:15098:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658598.579972:0:15098:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788658598.580397:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658598.580398:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658598.580399:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658598.580400:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658598.580401:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658598.580402:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658598.580403:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658598.580404:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658598.580405:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658598.580408:0:15098:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788658598.580410:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658598.580410:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658598.580411:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658598.580412:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658598.580412:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658598.580413:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658598.580414:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658598.580415:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658598.580415:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658598.580439:0:15098:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788658598.580454:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805440:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658598.580515:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.580559:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f44eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658598.580563:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103805440 00000100:00100000:1.0:1788658598.580570:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103805440 00000100:00100000:1.0:1788658598.580656:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658598.580691:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:15098:x1875544103805440:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658598.580734:0:14412:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788658598.580736:0:14412:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788658598.580739:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788658598.589068:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:15098:x1875544103805440:12345-0@lo:253:mount.lustre.0 Request processed in 8394us (8542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658598.589084:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658598.589200:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658598.589216:0:15098:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788658598.589219:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658598.589221:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658598.589235:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658598.589237:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658598.589238:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658598.589239:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658598.589241:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658598.589243:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658598.589244:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658598.589262:0:15098:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56e5c8d800 from lustre-OST0000 10000000:01000000:2.0:1788658598.589286:0:15098:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788658598.589289:0:15098:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788658598.589296:0:15098:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e56c83e4d40 local copy 00010000:00010000:2.0:1788658598.589308:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658598.589545:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658598.589580:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.589710:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658598.589807:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103805568 00000100:00100000:0.0:1788658598.589814:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103805568 00000100:00100000:0.0:1788658598.589859:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658598.589868:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:15098:x1875544103805568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658598.590107:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+12:15098:x1875544103805568:12345-0@lo:501:mount.lustre.0 Request processed in 239us (525us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658598.590114:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788658598.590172:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805568:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788658598.590186:0:15098:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788658598.590323:0:15098:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788658598.590330:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.590341:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658598.590363:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56e5c8d800 10000000:01000000:2.0:1788658598.590368:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788658598.590372:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e56c83e4d40 10000000:01000000:2.0:1788658598.590375:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788658598.590378:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e56c83e4d40 from 1 10000000:01000000:2.0:1788658598.590386:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788658598.590411:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.590420:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.590430:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658598.590444:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658598.590471:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.590590:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658598.590627:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103805696 00000100:00100000:1.0:1788658598.590632:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103805696 00000100:00100000:1.0:1788658598.590723:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658598.590731:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+12:15098:x1875544103805696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658598.590741:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658598.590754:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1678000/0xf657f176650ebbe7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebbe0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658598.590775:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678000/0xf657f176650ebbe7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebbe0 expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658598.590787:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1678000/0xf657f176650ebbe7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebbe0 expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658598.590807:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678000, rc 0) 00000100:00100000:1.0:1788658598.590844:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+13:15098:x1875544103805696:12345-0@lo:101:mount.lustre.0 Request processed in 114us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658598.590851:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788658598.590937:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658598.590949:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbe7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.590958:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebbe7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658598.590973:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788658598.590990:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbe7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.590998:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbe7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658598.591004:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788658598.591008:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658598.591018:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788658598.591020:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788658598.591034:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.591041:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.591049:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658598.591062:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658598.591087:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.591240:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658598.591305:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103805824 00000100:00100000:3.0:1788658598.591310:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103805824 00000100:00100000:3.0:1788658598.591332:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658598.591339:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+13:15098:x1875544103805824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658598.591347:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658598.591355:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebbee expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658598.591370:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebbee expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658598.591379:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebbee expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658598.591386:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ef200, rc 0) 00000100:00100000:3.0:1788658598.591462:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103805824:12345-0@lo:101:mount.lustre.0 Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658598.591468:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658598.591599:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658598.591609:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.591617:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658598.592259:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788658598.593245:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658598.593491:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788658598.593536:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788658598.593582:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788658598.593628:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788658598.593872:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788658598.593917:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788658598.593982:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788658598.593996:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788658598.594070:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658598.594125:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.594156:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658598.594703:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103805952 00000100:00100000:3.0:1788658598.594711:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103805952 00000100:00100000:3.0:1788658598.594760:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658598.594770:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103805952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658598.595125:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103805952:12345-0@lo:501:mount.lustre.0 Request processed in 355us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658598.595133:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658598.595353:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103805952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658598.595389:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658598.595431:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.595460:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cada6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658598.595506:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806080 00000100:00100000:3.0:1788658598.595511:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806080 00000100:00100000:3.0:1788658598.595581:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658598.595589:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103806080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658598.595918:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103806080:12345-0@lo:503:mount.lustre.0 Request processed in 329us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658598.595926:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658598.596045:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806080:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788658598.596704:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658598.596774:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658598.596831:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.597447:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56df107a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658598.597491:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806208 00000100:00100000:0.0:1788658598.597498:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806208 00000100:00100000:0.0:1788658598.597534:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788658598.597543:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103806208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658598.598217:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103806208:12345-0@lo:502:mount.lustre.0 Request processed in 671us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658598.598226:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788658598.598297:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658598.598632:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788658598.598978:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788658598.599017:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788658598.599067:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788658598.599104:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788658598.599137:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788658598.599196:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788658598.599232:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788658598.599265:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788658598.599386:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788658598.599425:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788658598.599469:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788658598.599524:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658598.599588:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.599661:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658598.599846:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806336 00000100:00100000:3.0:1788658598.599856:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806336 00000100:00100000:3.0:1788658598.599934:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658598.599945:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103806336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658598.600139:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103806336:12345-0@lo:502:mount.lustre.0 Request processed in 195us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658598.600147:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658598.600228:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658598.600316:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788658598.600329:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788658598.601250:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658598.601260:0:15112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788658598.601268:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658598.601270:0:15112:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788658598.601276:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658598.601291:0:15112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e56c56c3380) 00000020:00000080:2.0:1788658598.601323:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788658598.601330:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658598.601405:0:15112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56e5c8d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788658598.601413:0:15112:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658598.601419:0:15112:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf657f176650ebc03 00010000:00010000:2.0:1788658598.604474:0:15112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788658598.606982:0:15112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788658598.608650:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788658598.610940:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788658598.610957:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658598.610966:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658598.610968:0:15112:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788658598.610971:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788658598.610974:0:15112:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788658598.610976:0:15112:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658598.610978:0:15112:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658598.610979:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788658598.610981:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658598.610983:0:15112:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788658598.610985:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658598.610988:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658598.610989:0:15112:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658598.610993:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658598.610995:0:15112:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658598.610997:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658598.610999:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658598.611000:0:15112:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658598.611003:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658598.611005:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658598.611006:0:15112:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658598.611009:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788658598.611082:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658598.611086:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658598.611087:0:15112:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658598.611091:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788658598.620917:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788658598.620965:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788658598.620983:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.620995:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658598.621763:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56e5c8d800 from 1 10000000:01000000:0.0:1788658598.621769:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658598.621834:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.621845:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.621857:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658598.621889:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658598.621975:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658598.622025:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658598.622363:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806464 00000100:00100000:2.0:1788658598.622381:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806464 00000100:00100000:2.0:1788658598.622573:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658598.622584:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+14:15098:x1875544103806464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658598.622601:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658598.622616:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebc0a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.622644:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebc0a expref: 15 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.622657:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebc0a expref: 15 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.622698:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b600, rc 0) 00000100:00100000:2.0:1788658598.622749:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806464:12345-0@lo:101:mount.lustre.0 Request processed in 167us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658598.622755:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658598.623944:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658598.623974:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.623986:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658598.624648:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788658598.625540:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658598.625982:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788658598.626030:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788658598.626094:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788658598.626248:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788658598.626359:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658598.626439:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658598.626539:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658598.626586:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806592 00000100:00100000:3.0:1788658598.626596:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806592 00000100:00100000:3.0:1788658598.626703:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658598.626713:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658598.626982:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806592:12345-0@lo:501:mount.lustre.0 Request processed in 270us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658598.626992:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658598.627097:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658598.627325:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658598.627374:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.627772:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658598.627872:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806720 00000100:00100000:0.0:1788658598.627878:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806720 00000100:00100000:0.0:1788658598.627910:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658598.627919:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658598.628126:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806720:12345-0@lo:503:mount.lustre.0 Request processed in 207us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658598.628132:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658598.628291:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658598.628866:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658598.628942:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658598.629002:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.629024:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658598.629115:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806848 00000100:00100000:0.0:1788658598.629123:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806848 00000100:00100000:0.0:1788658598.629155:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658598.629165:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658598.629344:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806848:12345-0@lo:502:mount.lustre.0 Request processed in 180us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658598.629352:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658598.629520:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658598.629833:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788658598.629888:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788658598.629936:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788658598.629969:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788658598.630005:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788658598.630048:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788658598.630079:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788658598.630185:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788658598.630227:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658598.630281:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.630314:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658598.630445:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103806976 00000100:00100000:0.0:1788658598.630462:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103806976 00000100:00100000:0.0:1788658598.630496:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788658598.630504:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658598.630704:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103806976:12345-0@lo:502:mount.lustre.0 Request processed in 200us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658598.630717:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658598.631027:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103806976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658598.631213:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788658598.631227:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788658598.632260:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658598.632271:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658598.632273:0:15116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658598.632280:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56e5c8d800 00000020:00000080:1.0:1788658598.632282:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658598.632291:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658598.632293:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658598.632295:0:15116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658598.632297:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658598.632300:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658598.632301:0:15116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658598.632304:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56e5c8d800 00000020:00000080:1.0:1788658598.632306:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658598.632373:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658598.632377:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658598.632378:0:15116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658598.632380:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658598.632383:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658598.632384:0:15116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658598.632387:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56e5c8d800 00000020:00000080:1.0:1788658598.632389:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658598.632420:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658598.632424:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658598.632425:0:15116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788658598.632428:0:15116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788658598.636532:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788658598.636581:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658598.636720:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.636734:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658598.636790:0:15098:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788658598.636793:0:15098:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56e5c8d800 10000000:01000000:0.0:1788658598.636808:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56e5c8d800 10000000:01000000:0.0:1788658598.636814:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658598.636820:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56e5c8d800 from 1 10000000:01000000:0.0:1788658598.636823:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658598.636868:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.636877:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.636891:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658598.636921:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658598.636999:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658598.637045:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658598.637118:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103807104 00000100:00100000:1.0:1788658598.637135:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103807104 00000100:00100000:1.0:1788658598.637188:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658598.637197:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103807104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658598.637211:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658598.637225:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1679600/0xf657f176650ebc1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebc18 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658598.637251:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1679600/0xf657f176650ebc1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebc18 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658598.637263:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1679600/0xf657f176650ebc1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebc18 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658598.637271:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679600, rc 0) 00000100:00100000:1.0:1788658598.637311:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807104:12345-0@lo:101:mount.lustre.0 Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658598.637317:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658598.637739:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658598.637756:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.637776:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658598.638407:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788658598.638908:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658598.639176:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788658598.639223:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788658598.639261:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788658598.639324:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788658598.639378:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788658598.639428:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788658598.639464:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788658598.639500:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788658598.639551:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788658598.639586:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788658598.639618:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788658598.639711:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788658598.639750:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788658598.639780:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788658598.639838:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788658598.639870:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788658598.639897:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788658598.639936:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788658598.639968:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788658598.639997:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788658598.640061:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788658598.640091:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788658598.640119:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788658598.640156:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788658598.640182:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788658598.640206:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788658598.640255:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788658598.640286:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788658598.640358:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788658598.640368:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788658598.640487:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658598.640583:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658598.640645:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658598.641218:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103807232 00000100:00100000:1.0:1788658598.641231:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103807232 00000100:00100000:1.0:1788658598.641307:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658598.641318:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658598.641695:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807232:12345-0@lo:501:mount.lustre.0 Request processed in 377us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658598.641703:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658598.643790:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff645c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658598.643882:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658598.643971:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.644024:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658598.644185:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103807360 00000100:00100000:2.0:1788658598.644193:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103807360 00000100:00100000:2.0:1788658598.644244:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788658598.644254:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658598.644445:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807360:12345-0@lo:503:mount.lustre.0 Request processed in 192us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658598.644453:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788658598.644547:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658598.646394:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658598.646501:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658598.646605:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.646657:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658598.646740:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103807488 00000100:00100000:1.0:1788658598.646749:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103807488 00000100:00100000:1.0:1788658598.646811:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788658598.646821:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658598.647075:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807488:12345-0@lo:502:mount.lustre.0 Request processed in 254us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658598.647083:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788658598.649985:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658598.650484:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788658598.650558:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788658598.650615:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788658598.650697:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788658598.650735:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788658598.650810:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788658598.650848:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788658598.650878:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788658598.650925:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788658598.650960:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788658598.650994:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788658598.663816:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788658598.663929:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788658598.663960:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788658598.664024:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788658598.664061:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788658598.664095:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788658598.664158:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788658598.664213:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788658598.664246:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788658598.664295:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788658598.664331:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788658598.664365:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788658598.664412:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788658598.664449:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788658598.664482:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788658598.664529:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788658598.664566:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788658598.664598:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788658598.664645:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788658598.664711:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788658598.664745:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788658598.664778:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788658598.664840:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788658598.664894:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788658598.664946:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788658598.664981:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788658598.665016:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788658598.665064:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788658598.665100:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788658598.665155:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658598.665247:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.665310:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658598.665652:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103807616 00000100:00100000:3.0:1788658598.665685:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103807616 00000100:00100000:3.0:1788658598.665758:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788658598.665768:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658598.666026:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103807616:12345-0@lo:502:mount.lustre.0 Request processed in 259us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658598.666034:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658598.668260:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103807616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658598.668417:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788658598.668442:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788658598.673452:0:15121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788658598.673472:0:15121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e56fb3bb380) 00000020:00000080:3.0:1788658598.673494:0:15121:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788658598.673562:0:15121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56e5c8d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658598.673566:0:15121:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56e5c8d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658598.673569:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56e5c8d800 3 00010000:00080000:3.0:1788658598.673606:0:15121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56eec07800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.103@tcp at head 00010000:00010000:3.0:1788658598.681411:0:15121:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788658598.682395:0:15121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788658598.682431:0:15121:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788658598.682453:0:15121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf657f176650ebc2d 00000100:00080000:3.0:1788658598.682464:0:15121:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658598.682471:0:15121:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e56eec07800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658598.682507:0:15121:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefd9c00 x1875544103807744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658598.682561:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103807744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788658598.682632:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788658598.682712:0:15121:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788658598.686362:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103807744 00000100:00100000:2.0:1788658598.686378:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103807744 00000100:00100000:2.0:1788658598.686429:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658598.686438:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103807744:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788658598.686480:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1788658598.686545:0:14418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf657f176650ebc34 00000004:00100000:2.0:1788658598.686568:0:14418:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658598.686611:0:14418:0:(import.c:65:import_set_state_nolock()) ffff9e56db3f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658598.686734:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875544103807744:12345-0@lo:38:llog_process_th.0 Request processed in 296us (4101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658598.686741:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788658598.686773:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658598.686778:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658598.686781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658598.686785:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658598.686870:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103807872:0@lo:400:kworker.0 00000100:00100000:2.0:1788658598.686910:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.686958:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103807872 00000100:00100000:2.0:1788658598.686963:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103807872 00000100:00100000:2.0:1788658598.686992:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658598.686998:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103807872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658598.687037:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103807872:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658598.687043:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788658598.687080:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e55c2400e00 x1875544103807872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658598.687094:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103807872:0@lo:400:kworker.0 00010000:00080000:2.0:1788658598.687914:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e56fefd9c00 x1875544103807744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658598.687932:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658598.687945:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788658598.687956:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788658598.687962:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788658598.687964:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56eec07800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658598.687971:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103807744:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788658598.691332:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788658598.692195:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788658598.692232:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658598.692259:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658598.692273:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788658598.692329:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788658598.692331:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658598.692332:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658598.692333:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658598.692335:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658598.692336:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658598.692337:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658598.692339:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658598.692341:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658598.692345:0:15098:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788658598.692348:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788658598.692350:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658598.692351:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658598.692352:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658598.692353:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658598.692354:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658598.692355:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658598.692356:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658598.692357:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658598.692384:0:15098:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788658598.692406:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103808000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788658598.692492:0:15098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658598.692540:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808000 00000100:00100000:1.0:1788658598.692549:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808000 00000100:00100000:1.0:1788658598.692603:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658598.692614:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:15098:x1875544103808000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658598.692652:0:14412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788658598.692703:0:14412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788658598.694487:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051ee40 going to sleep for 11 seconds 20000000:01000000:3.0:1788658598.744584:0:14412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658598.744637:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788658598.746926:0:14434:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788658598.746939:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788658598.747245:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.747266:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebba1 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.747275:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.747322:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ebba1 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.747339:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ebba1 expref: 16 pid: 14414 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658598.747355:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875544103808128:0@lo:104: 00000100:00100000:2.0:1788658598.747427:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658598.747531:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6754e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658598.749987:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808128 00000100:00100000:2.0:1788658598.750006:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808128 00000100:00100000:2.0:1788658598.750074:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658598.750086:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7221c739-be00-4743-a572-f61de58b82dc+3:14434:x1875544103808128:12345-0@lo:104: 00010000:00010000:2.0:1788658598.750262:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658598.750376:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658598.750383:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7221c739-be00-4743-a572-f61de58b82dc+3:14434:x1875544103808128:12345-0@lo:104: Request processed in 300us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658598.750390:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788658598.750454:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658598.750462:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750470:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658598.750475:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750484:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658598.750491:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658598.750497:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658598.750547:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750554:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658598.750578:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750596:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebba8 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750616:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658598.750618:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658598.750619:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658598.750637:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103808256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658598.750713:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658598.750779:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808256 00000100:00100000:0.0:1788658598.750785:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808256 00010000:00010000:0.0:1788658598.750819:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebba1 expref: 17 pid: 14414 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658598.750845:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658598.750853:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+17:3305:x1875544103808256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658598.750863:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658598.750869:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebba1 expref: 17 pid: 14414 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750880:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ebba1 expref: 17 pid: 14414 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750902:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750911:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658598.750929:0:14405:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003991086s 00010000:00010000:0.0:1788658598.750940:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750948:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750968:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750975:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750981:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658598.750986:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.750994:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.751004:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658598.751015:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658598.751047:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+17:3305:x1875544103808256:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658598.751054:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658598.751094:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103808256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658598.751297:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ebba1 expref: 16 pid: 14414 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658598.751310:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875544103808128:0@lo:104: 00010000:00010000:3.0:1788658598.751325:0:14434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658598.751334:0:14434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658598.751347:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658598.751353:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891a400/0xf657f176650ebc3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658598.754872:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+15:15098:x1875544103808000:12345-0@lo:253:mount.lustre.0 Request processed in 62249us (62369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658598.754889:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658598.755016:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15098:1875544103808000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788658598.755039:0:15098:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788658598.755043:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788658598.755045:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658598.755046:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658598.755047:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658598.755049:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658598.755050:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658598.755052:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658598.755054:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658598.755056:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788658598.755074:0:15098:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788658598.764500:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788658598.765292:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788658598.765510:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788658598.766624:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788658598.766916:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788658598.767431:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788658598.769229:0:15098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788658598.817865:0:15098:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788658598.817876:0:15098:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788658598.817913:0:15098:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658598.817985:0:15098:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658598.818000:0:15098:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788658598.818030:0:15098:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788658599.133515:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788658599.836919:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658599.836928:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56d00a1000 from 7 10000000:01000000:3.0:1788658599.836934:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658599.836985:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658599.836998:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658599.837010:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658599.837039:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103808384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658599.837111:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658599.837166:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c95f1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658599.837218:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808384 00000100:00100000:2.0:1788658599.837227:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808384 00000100:00100000:2.0:1788658599.837282:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658599.837292:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+15:14416:x1875544103808384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658599.837305:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658599.837318:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebc42 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658599.837342:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebc42 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658599.837352:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebc42 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658599.837373:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a200, rc 0) 00000100:00100000:2.0:1788658599.837425:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+16:14416:x1875544103808384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658599.837431:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658599.837542:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103808384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658599.837557:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658599.837566:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658599.837619:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103808512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788658599.837655:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658599.837776:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56df1073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658599.839696:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808512 00000100:00100000:2.0:1788658599.839706:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808512 00000100:00100000:2.0:1788658599.839757:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658599.839767:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:14416:x1875544103808512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788658599.839790:0:14412:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788658599.839806:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788658599.839809:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788658599.839938:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:14416:x1875544103808512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658599.839946:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788658599.842003:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103808512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788658599.842104:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658599.842116:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658599.842127:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658600.157881:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658601.181463:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658602.211855:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658603.228847:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658603.937928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658603.937936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658603.937939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658603.937943:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658603.938026:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103808768:0@lo:400:kworker.0 00000100:00100000:1.0:1788658603.938098:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658603.938159:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658603.938165:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103808640:0@lo:400:kworker.0 00000100:00100000:1.0:1788658603.938329:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658603.938369:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103808896:0@lo:400:kworker.0 00000100:00100000:1.0:1788658603.938402:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658603.938447:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808768 00000100:00100000:1.0:1788658603.938455:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808768 00000100:00100000:1.0:1788658603.938513:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808896 00000100:00100000:1.0:1788658603.938516:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808896 00000100:00100000:1.0:1788658603.938553:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658603.938561:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103808768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658603.938612:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103808768:12345-0@lo:400:kworker.0 Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658603.938620:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658603.938637:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658603.938644:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103808896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658603.938706:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103808896:12345-0@lo:400:kworker.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658603.938713:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658603.938730:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103808640 00000100:00100000:1.0:1788658603.938734:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103808640 00000100:00100000:1.0:1788658603.938756:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658603.938762:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+16:3307:x1875544103808640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658603.938789:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+16:3307:x1875544103808640:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658603.938795:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788658603.938848:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5700569180 x1875544103808896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658603.938863:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103808896:0@lo:400:kworker.0 00000100:00100000:1.0:1788658603.938889:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103808640:0@lo:400:kworker.0 00010000:00080000:1.0:1788658603.938899:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5700569f80 x1875544103808768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658603.938920:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103808768:0@lo:400:kworker.0 00000100:00080000:3.0:1788658603.939859:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658604.255920:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658605.282174:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658605.725796:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788658606.273513:0:15467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788658606.301060:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658607.324816:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.348869:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658608.924817:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658593/real 1788658593] req@ffff9e570056a300 x1875544103805184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658608 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658608.924874:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e570056a300 x1875544103805184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658608 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658608.924886:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658593/real 1788658593] req@ffff9e5700568a80 x1875544103805312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658608 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658608.924897:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5700568a80 x1875544103805312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658608 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658608.924920:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e5700dc6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658608.924950:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788658608.924955:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103805184:0@lo:8:kworker.0 00000100:00080000:3.0:1788658608.924960:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658608.924966:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788658608.924968:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103805312:0@lo:8:kworker.0 00000100:00080000:0.0:1788658608.925130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658608.925134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788658608.925137:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5700dc6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658608.925143:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:0.0:1788658608.925148:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788658608.925155:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5700dc6800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1788658608.925184:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56ff644380 x1875544103809152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658608.925383:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103809152:0@lo:8:kworker.0 00000100:00100000:3.0:1788658608.925458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658608.925572:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103809024:0@lo:400:kworker.0 00000100:00100000:1.0:1788658608.925608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658608.925697:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809152 00000100:00100000:1.0:1788658608.925706:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809152 00000100:00100000:1.0:1788658608.925740:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658608.925748:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103809152:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788658608.925775:0:15100:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1788658608.925802:0:15100:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ebc50 00002000:00100000:1.0:1788658608.925817:0:15100:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e570051b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788658608.925821:0:15100:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788658608.925824:0:15100:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788658608.926171:0:15100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788658608.926209:0:15100:0:(import.c:65:import_set_state_nolock()) ffff9e5700518000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658608.926320:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809024 00000100:00100000:2.0:1788658608.926325:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809024 00000100:00100000:2.0:1788658608.926362:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658608.926369:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:3305:x1875544103809024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658608.926409:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+16:3305:x1875544103809024:12345-0@lo:400:kworker.0 Request processed in 40us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658608.926416:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658608.926462:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103809024:0@lo:400:kworker.0 00000100:00080000:0.0:1788658608.927549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658608.927558:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788658608.927562:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658608.927569:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:0.0:1788658608.927574:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788658608.927581:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183a000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1788658608.927624:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56ff647b80 x1875544103809280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658608.931847:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103809280:0@lo:8:kworker.0 00000100:00100000:3.0:1788658608.931936:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658608.932068:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788658608.932079:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788658608.932384:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875544103809152:12345-0@lo:8:kworker.0 Request processed in 6633us (6923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658608.932394:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658608.932418:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809280 00000100:00100000:1.0:1788658608.932426:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809280 00000100:00100000:1.0:1788658608.932455:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658608.932462:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103809280:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788658608.932485:0:15100:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788658608.932530:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103809280:12345-0@lo:8:kworker.0 Request processed in 67us (593us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658608.932564:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788658608.935047:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56ff644380 x1875544103809152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658608.935063:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658608.935073:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788658608.935083:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788658608.935089:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788658608.935102:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e5700dc6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788658608.935179:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788658608.935185:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103809152:0@lo:8:kworker.0 00000100:00080000:3.0:1788658608.936403:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658608.936414:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788658608.936418:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103809280:0@lo:8:kworker.0 00000004:00080000:1.0:1788658608.936714:0:14440:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788658608.937520:0:14440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 500076853293ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788658608.939769:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103809536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658608.939855:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658608.939910:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658608.939919:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103809408:0@lo:400:kworker.0 00000100:00100000:3.0:1788658608.939958:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658608.939999:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809408 00000100:00100000:3.0:1788658608.940009:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809408 00000100:00100000:3.0:1788658608.940075:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658608.940086:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103809408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658608.940140:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103809408:12345-0@lo:400:kworker.0 Request processed in 56us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658608.940148:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788658608.940193:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56ff647100 x1875544103809408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658608.940240:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103809408:0@lo:400:kworker.0 00000100:00100000:0.0:1788658608.944711:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658608.944744:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103809664:0@lo:400:kworker.0 00000100:00100000:0.0:1788658608.944825:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658608.944906:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809536 00000100:00100000:1.0:1788658608.944917:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809536 00000100:00100000:1.0:1788658608.944984:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658608.944994:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103809536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658608.945030:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658608.945084:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103809536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658608.945091:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788658608.945123:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788658608.945159:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e55c2403100 x1875544103809536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658608.945181:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103809536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658608.945771:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809664 00000100:00100000:3.0:1788658608.945778:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809664 00000100:00100000:3.0:1788658608.945824:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658608.945831:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103809664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658608.945891:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103809664:12345-0@lo:400:kworker.0 Request processed in 60us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658608.945898:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788658608.946328:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658608.946375:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56ff646d80 x1875544103809664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658608.946387:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103809664:0@lo:400:kworker.0 00000004:00080000:2.0:1788658608.952031:0:14441:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788658608.952098:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875544103809792:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788658608.952173:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658608.952637:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809792 00000100:00100000:2.0:1788658608.952646:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809792 00000100:00100000:2.0:1788658608.952737:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658608.952747:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14441:x1875544103809792:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788658608.960394:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56eec94600 going to sleep for 11 seconds 00002000:00080000:2.0:1788658608.969064:0:15100:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788658608.969077:0:15100:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788658608.969084:0:15100:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788658608.985598:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.985612:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985634:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.985639:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.985645:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985681:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985695:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985713:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985733:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658608.985747:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658608.985753:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985761:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658608.985766:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985775:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985792:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985801:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.985821:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.985823:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.985825:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658608.987603:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.987624:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.987640:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.987645:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.987651:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.988460:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.988479:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.988488:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.989110:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658608.989531:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658608.989550:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.989562:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ba00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658608.989567:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.989578:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.989603:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.989610:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0028ad4/0xf657f176650ebc5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.989635:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658608.989637:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658608.989639:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658608.990400:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.990410:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.990424:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.990429:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.990436:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.990449:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.990464:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.990472:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.990499:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658608.990628:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658608.990636:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.990656:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658608.990660:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.990692:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.990706:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.990714:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffff1689/0xf657f176650ebc65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658608.990732:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658608.990734:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658608.990736:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658608.992336:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.992350:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.992367:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.992372:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.992378:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.992391:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.992400:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.992408:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.992448:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658608.992952:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658608.992963:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658608.992975:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658608.992980:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658608.992998:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658608.993018:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658608.993026:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb3c4096/0xf657f176650ebc6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658608.993051:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658608.993053:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658608.993055:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658608.994258:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.994271:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994287:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.994292:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.994299:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994313:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994323:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994330:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994353:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658608.994369:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658608.994375:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994384:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658608.994396:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994406:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994422:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994429:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb5f50c/0xf657f176650ebc73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994446:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.994448:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.994450:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658608.994979:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.994986:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.994997:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.995000:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.997116:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997149:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997163:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997179:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997209:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658608.997242:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658608.997249:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997258:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658608.997264:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997274:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997291:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997300:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009396da2c/0xf657f176650ebc7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.997334:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.997336:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.997338:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658608.998259:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.998278:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998292:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.998297:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.998303:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998314:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998323:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998331:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998353:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658608.998368:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658608.998372:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998380:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658608.998384:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998392:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998409:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998416:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004639ec24/0xf657f176650ebc81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998434:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.998435:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658608.998437:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658608.998891:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658608.998898:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998907:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658608.998911:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658608.998916:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998925:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998933:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998940:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998968:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658608.998979:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658608.998983:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.998990:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658608.998993:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658608.999000:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.000131:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.000142:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e09d79df/0xf657f176650ebc88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.000209:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.000212:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.000214:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658609.000917:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658609.000926:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.000942:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658609.000956:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658609.000965:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.000984:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.000996:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658609.001506:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788658609.002135:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.002167:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658609.002378:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658609.002387:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002394:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658609.002398:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002409:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002435:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002442:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007473e902/0xf657f176650ebc8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002463:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658609.002465:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658609.002467:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.002919:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.002926:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002939:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.002943:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.002948:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002962:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002973:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.002982:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.003011:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658609.004145:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.004155:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.004167:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.004172:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.004183:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.004202:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.004238:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bef19e7/0xf657f176650ebc96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.004261:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.004263:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.004265:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.004868:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.004877:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.004891:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.004895:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.004900:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.004914:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.004924:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.004933:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.004964:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658609.005101:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.005108:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.005116:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.005120:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.005130:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.005142:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.005150:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024c38d05/0xf657f176650ebc9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.005165:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.005166:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.005168:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.006944:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.006956:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.006974:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.006983:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.006990:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.007005:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.007015:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.007024:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.007046:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658609.007129:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.007136:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.007144:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.007148:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.007156:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.007170:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.007177:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d742c46e/0xf657f176650ebca4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.007194:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.007196:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.007197:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.010134:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.010628:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.010647:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.010652:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.010659:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.010694:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.010706:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.010721:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.010790:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658609.014935:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.014951:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.014972:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.014977:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.014983:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.014999:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.015010:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.015019:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.015103:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658609.015112:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.015121:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eea00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658609.015125:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.015135:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.015156:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.015182:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1179bc2/0xf657f176650ebcab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.015564:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.015570:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.015578:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efe00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.015581:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.015600:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.015612:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.015622:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.015624:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.015626:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658609.016464:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788658609.016475:0:15100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d2bafd/0xf657f176650ebcb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.017840:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.018739:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.018751:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.018768:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.018774:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.018781:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.018796:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.018807:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.018813:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.018835:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658609.019100:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.019108:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019116:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efc00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.019121:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019131:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019148:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019154:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e871fb16/0xf657f176650ebcb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019187:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.019189:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.019190:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.019348:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.019354:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019363:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.019366:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.019375:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019386:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019394:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019402:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019424:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658609.019537:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.019542:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019551:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.019555:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019563:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019575:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019583:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007b3a740/0xf657f176650ebcc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.019596:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.019598:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.019600:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.019837:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.019842:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019851:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.019854:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.019858:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019868:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019876:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019894:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.019914:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658609.020328:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.020334:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020344:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.020347:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.020352:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020360:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020368:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020376:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020387:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658609.020782:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1788658609.020787:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658609.020790:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020793:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020806:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788658609.020808:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658609.020809:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658609.020813:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020814:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020824:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020826:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020833:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020841:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020842:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.020850:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658609.020850:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bfcf795/0xf657f176650ebcc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020868:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658609.020872:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020879:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.020882:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020889:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020898:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020910:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d32aadea/0xf657f176650ebcce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020923:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.020926:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020932:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.020936:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020944:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020954:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020961:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d677b7/0xf657f176650ebcd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.020973:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.020975:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.020977:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.020983:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.021251:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.021257:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021265:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.021268:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.021273:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021283:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021300:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021308:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021332:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658609.021771:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.021776:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021785:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.021788:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.021792:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021801:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021810:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021817:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.021849:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658609.021860:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658609.021867:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021881:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.021885:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021895:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021909:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021916:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005235094d/0xf657f176650ebcdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021931:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658609.021934:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021940:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658609.021944:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021951:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021961:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021973:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d99af001/0xf657f176650ebce3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.021986:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.021988:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.021990:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.023282:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.023372:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.023386:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.023389:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.023394:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.023407:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.023416:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.023425:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.023448:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658609.023506:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658609.023513:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.023521:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29de200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658609.023525:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.023534:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.023551:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.023566:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004254cbb0/0xf657f176650ebcea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.023587:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.023588:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.023590:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.025081:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.025092:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025106:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.025119:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.025126:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025139:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025149:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025158:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025184:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658609.025278:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658609.025287:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.025296:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfe00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658609.025301:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.025310:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.025324:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.025331:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ab002a/0xf657f176650ebcf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.025351:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.025353:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.025354:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658609.025439:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.025928:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.025936:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025946:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.025951:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.025956:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025966:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025976:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.025988:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.026013:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658609.026101:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658609.026106:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026114:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfc00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658609.026117:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026126:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026139:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026146:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ab8351/0xf657f176650ebcf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026161:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.026162:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.026164:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.026583:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.026589:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.026599:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.026602:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.026607:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.026616:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.026624:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.026630:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.026657:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658609.026706:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658609.026712:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026720:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dea00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658609.026724:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026744:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026755:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026763:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099acae39/0xf657f176650ebcff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.026777:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.026779:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.026781:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658609.027194:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.027279:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027364:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.027367:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.027372:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027382:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027391:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027399:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027454:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658609.027904:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658609.027910:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027919:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788658609.027922:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658609.027927:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027936:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027955:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.027962:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028063:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658609.028071:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028078:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29de400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658609.028082:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028091:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028104:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028112:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f0e147/0xf657f176650ebd06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028130:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658609.028133:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028139:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29df200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658609.028149:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028157:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028166:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.028175:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658609.028176:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658609.028178:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658609.028386:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788658609.028392:0:15100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3b1ebac/0xf657f176650ebd0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788658609.028643:0:15100:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:1.0:1788658609.028859:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658609.029470:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14441:x1875544103809792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 76718us (77290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658609.029501:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658609.030726:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875544103809792:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788658609.030751:0:14441:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788658609.030805:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875544103809920:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788658609.030855:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.030902:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103809920 00000100:00100000:3.0:1788658609.030910:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103809920 00000100:00100000:2.0:1788658609.030910:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56eec94600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658609.030998:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658609.031007:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14441:x1875544103809920:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788658609.031068:0:15102:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788658609.036406:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14441:x1875544103809920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5392us (5542us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788658609.036420:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658609.037005:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14441:1875544103809920:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788658609.037086:0:14441:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:1.0:1788658609.132788:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788658609.132819:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1788658609.373724:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658610.414894:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658611.429723:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658612.447282:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658613.192020:0:15819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788658613.192024:0:15819:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788658613.192144:0:15819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e56eec4f000 00000020:01000004:0.0:1788658613.192164:0:15819:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788658613.192180:0:15819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788658613.192194:0:15819:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e56e6ee4d40) 00000020:00000080:0.0:1788658613.192212:0:15819:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788658613.209265:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788658613.211092:0:15819:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788658613.211995:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788658613.212248:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788658613.212472:0:15819:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788658613.212934:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:0.0:1788658613.213030:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1788658613.213172:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1788658613.213627:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 312: rc = 0 00100000:10000000:0.0:1788658613.213995:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 312: rc = 0 00100000:10000000:0.0:1788658613.214245:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 312: rc = 0 00100000:10000000:0.0:1788658613.215224:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 312: rc = 0 00100000:10000000:0.0:1788658613.215498:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 312: rc = 0 00100000:10000000:0.0:1788658613.215919:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 312: rc = 0 00000020:00000080:0.0:1788658613.216545:0:15819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788658613.216559:0:15819:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788658613.216570:0:15819:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf657f176650ebd1b 00000020:01000004:0.0:1788658613.216580:0:15819:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788658613.216604:0:15819:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788658613.216607:0:15819:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788658613.216612:0:15819:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788658613.216635:0:15819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788658613.216639:0:15819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788658613.239178:0:15819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658613.239304:0:15819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.103@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788658613.239309:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658613.239310:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658613.239312:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658613.239313:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658613.239314:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658613.239316:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658613.239317:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658613.239319:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658613.239320:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658613.239324:0:15819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788658613.239327:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658613.239328:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658613.239334:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658613.239335:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658613.239336:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658613.239337:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658613.239337:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658613.239338:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658613.239339:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658613.239370:0:15819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788658613.239398:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788658613.239516:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658613.239931:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f447ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658613.240249:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810048 00000100:00100000:1.0:1788658613.240259:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810048 00000100:00100000:1.0:1788658613.240361:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658613.240372:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+16:15819:x1875544103810048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658613.240420:0:14413:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788658613.240425:0:14413:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788658613.240430:0:14413:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788658613.248158:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+16:15819:x1875544103810048:12345-0@lo:253:mount.lustre.0 Request processed in 7777us (8631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.248177:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788658613.248362:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658613.248383:0:15819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788658613.248387:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658613.248389:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658613.248391:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658613.248392:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658613.248393:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658613.248395:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658613.248396:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658613.248398:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658613.248400:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658613.248436:0:15819:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56eec4f000 from lustre-OST0001 10000000:01000000:2.0:1788658613.248853:0:15819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788658613.248857:0:15819:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788658613.248866:0:15819:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e56c83e4d40 local copy 00010000:00010000:2.0:1788658613.248876:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658613.249109:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658613.249151:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.249258:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c0de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658613.249320:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810176 00000100:00100000:0.0:1788658613.249326:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810176 00000100:00100000:0.0:1788658613.249373:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788658613.249382:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+16:15819:x1875544103810176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658613.249580:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+16:15819:x1875544103810176:12345-0@lo:501:mount.lustre.0 Request processed in 198us (428us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658613.249588:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788658613.249951:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810176:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788658613.249969:0:15819:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788658613.250117:0:15819:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788658613.250127:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.250139:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658613.250173:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56eec4f000 10000000:01000000:2.0:1788658613.250179:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788658613.250261:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788658613.250266:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658613.250272:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788658613.250276:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788658613.250309:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.250318:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.250339:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658613.250358:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658613.250399:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.250445:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c0de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658613.250516:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810304 00000100:00100000:0.0:1788658613.250522:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810304 00000100:00100000:0.0:1788658613.250565:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658613.250575:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+16:15819:x1875544103810304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658613.250585:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658613.250599:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79600/0xf657f176650ebd29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebd22 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.250622:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79600/0xf657f176650ebd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebd22 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.250641:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79600/0xf657f176650ebd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebd22 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.250650:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79600, rc 0) 00000100:00100000:0.0:1788658613.250796:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810304:12345-0@lo:101:mount.lustre.0 Request processed in 144us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.250803:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788658613.250931:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658613.250946:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658613.250968:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658613.252015:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788658613.253266:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658613.253544:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788658613.253589:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788658613.253623:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788658613.253707:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788658613.253756:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788658613.253787:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788658613.253849:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788658613.253858:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788658613.253954:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658613.254032:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658613.254093:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658613.254372:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810432 00000100:00100000:3.0:1788658613.254382:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810432 00000100:00100000:3.0:1788658613.254447:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658613.254457:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658613.255226:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810432:12345-0@lo:501:mount.lustre.0 Request processed in 769us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658613.255237:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658613.255517:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658613.255577:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658613.255627:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658613.255652:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658613.255736:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810560 00000100:00100000:0.0:1788658613.255742:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810560 00000100:00100000:0.0:1788658613.255786:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658613.255795:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658613.256158:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810560:12345-0@lo:503:mount.lustre.0 Request processed in 362us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.256166:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788658613.256423:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658613.257137:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658613.257576:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658613.257628:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658613.257657:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658613.257850:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810688 00000100:00100000:0.0:1788658613.257856:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810688 00000100:00100000:0.0:1788658613.257904:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788658613.257914:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658613.258127:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810688:12345-0@lo:502:mount.lustre.0 Request processed in 212us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.258136:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658613.258285:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658613.258571:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788658613.258622:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788658613.258654:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788658613.261507:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788658613.261577:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788658613.261611:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788658613.261660:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788658613.262022:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788658613.262083:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788658613.262152:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658613.262339:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658613.262457:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e570118ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658613.262890:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810816 00000100:00100000:3.0:1788658613.262901:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810816 00000100:00100000:3.0:1788658613.263019:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788658613.263031:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658613.263303:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810816:12345-0@lo:502:mount.lustre.0 Request processed in 273us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658613.263311:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658613.263399:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658613.263502:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788658613.263517:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788658613.267708:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788658613.267796:0:15821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788658613.267805:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658613.267808:0:15821:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788658613.267816:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658613.267834:0:15821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e56c64499c0) 00000020:00000080:1.0:1788658613.267861:0:15821:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788658613.267867:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788658613.267957:0:15821:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56eec4f000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788658613.267966:0:15821:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788658613.267972:0:15821:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf657f176650ebd37 00010000:00010000:1.0:1788658613.273520:0:15821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788658613.274128:0:15821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788658613.276946:0:15821:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788658613.278113:0:15821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788658613.278125:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658613.278131:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658613.278133:0:15821:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788658613.278137:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658613.278141:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658613.278142:0:15821:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658613.278145:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658613.278148:0:15821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658613.278150:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658613.278152:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658613.278153:0:15821:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658613.278156:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658613.278158:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658613.278159:0:15821:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658613.278162:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788658613.278225:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658613.278228:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658613.278230:0:15821:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658613.278234:0:15821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788658613.278507:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788658613.278533:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788658613.278548:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658613.278557:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658613.278564:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56eec4f000 from 1 10000000:01000000:3.0:1788658613.278566:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658613.278602:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658613.278609:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658613.278621:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658613.278659:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658613.278813:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658613.278847:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658613.279852:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103810944 00000100:00100000:2.0:1788658613.279861:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103810944 00000100:00100000:2.0:1788658613.279906:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658613.279914:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+17:15819:x1875544103810944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658613.279936:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658613.279949:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebd3e expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.279970:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebd3e expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.279979:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebd3e expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.279985:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b200, rc 0) 00000100:00100000:2.0:1788658613.280027:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103810944:12345-0@lo:101:mount.lustre.0 Request processed in 114us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.280032:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788658613.280148:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103810944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658613.280163:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658613.280171:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658613.281841:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788658613.282183:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658613.282433:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788658613.282464:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788658613.282498:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788658613.282503:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788658613.282572:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658613.282634:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658613.282697:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811072 00000100:00100000:3.0:1788658613.282703:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811072 00000100:00100000:3.0:1788658613.284050:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788658613.284070:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658613.284386:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811072:12345-0@lo:501:mount.lustre.0 Request processed in 324us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658613.284394:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788658613.284467:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658613.284495:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658613.284544:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658613.284589:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658613.284616:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658613.284754:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811200 00000100:00100000:2.0:1788658613.284762:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811200 00000100:00100000:2.0:1788658613.284798:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658613.284806:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658613.285092:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811200:12345-0@lo:503:mount.lustre.0 Request processed in 286us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.285099:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658613.285141:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788658613.286051:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658613.286128:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658613.286184:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.286229:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811328 00000100:00100000:2.0:1788658613.286234:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811328 00000100:00100000:2.0:1788658613.286275:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658613.286282:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658613.286472:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811328:12345-0@lo:502:mount.lustre.0 Request processed in 190us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.286479:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658613.286524:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c0d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658613.286544:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658613.286806:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788658613.286860:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788658613.286914:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788658613.286970:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788658613.287001:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788658613.287048:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788658613.287071:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788658613.287087:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788658613.287107:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658613.287140:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.287164:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811456 00000100:00100000:2.0:1788658613.287167:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811456 00000100:00100000:2.0:1788658613.287185:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658613.287190:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658613.287313:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811456:12345-0@lo:502:mount.lustre.0 Request processed in 121us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.287320:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658613.287348:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c0d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658613.287359:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658613.287444:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788658613.287464:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788658613.291937:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658613.291956:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658613.291959:0:15825:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658613.291966:0:15825:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56eec4f000 00000020:00000080:1.0:1788658613.291969:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658613.291976:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658613.291979:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658613.291980:0:15825:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658613.291983:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658613.291985:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658613.291986:0:15825:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658613.291989:0:15825:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56eec4f000 00000020:00000080:1.0:1788658613.291991:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658613.292081:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658613.292085:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658613.292086:0:15825:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658613.292089:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658613.292091:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658613.292092:0:15825:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658613.292095:0:15825:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56eec4f000 00000020:00000080:1.0:1788658613.292097:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658613.300301:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658613.300314:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658613.300317:0:15825:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788658613.300323:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788658613.300397:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788658613.300433:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658613.300458:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.300472:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658613.300516:0:15819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788658613.300519:0:15819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56eec4f000 10000000:01000000:2.0:1788658613.300523:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56eec4f000 10000000:01000000:2.0:1788658613.300527:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658613.300532:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56eec4f000 from 1 10000000:01000000:2.0:1788658613.300535:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658613.300578:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.300587:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.300927:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658613.300954:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658613.301017:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.301097:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e01b5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658613.301263:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811584 00000100:00100000:3.0:1788658613.301272:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811584 00000100:00100000:3.0:1788658613.301362:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658613.301372:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103811584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658613.301387:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658613.301402:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dee00/0xf657f176650ebd53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebd4c expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658613.301440:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dee00/0xf657f176650ebd53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebd4c expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658613.301452:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dee00/0xf657f176650ebd53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebd4c expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658613.301461:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dee00, rc 0) 00000100:00100000:3.0:1788658613.301508:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103811584:12345-0@lo:101:mount.lustre.0 Request processed in 138us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658613.301515:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788658613.301585:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658613.301614:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.301625:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658613.302281:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788658613.302792:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658613.303055:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788658613.303104:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788658613.303141:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788658613.303187:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788658613.303223:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788658613.303270:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788658613.303306:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788658613.303338:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788658613.303407:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788658613.303458:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788658613.303491:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788658613.303537:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788658613.303570:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788658613.303600:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788658613.303646:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788658613.303712:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788658613.303745:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788658613.303789:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788658613.303817:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788658613.303846:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788658613.303891:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788658613.303925:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788658613.303955:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788658613.304014:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788658613.304064:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788658613.304098:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788658613.304146:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788658613.304180:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788658613.304212:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788658613.304256:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788658613.304290:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788658613.304322:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788658613.304355:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788658613.304402:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788658613.314288:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788658613.314450:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788658613.314491:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788658613.321538:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788658613.321572:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788658613.321727:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658613.321811:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.321862:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e01b5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658613.322607:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811712 00000100:00100000:3.0:1788658613.322624:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811712 00000100:00100000:3.0:1788658613.322716:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788658613.322880:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103811712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658613.323458:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103811712:12345-0@lo:501:mount.lustre.0 Request processed in 581us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658613.323474:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788658613.323583:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658613.323641:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658613.329896:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.329943:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56e01b5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658613.330043:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811840 00000100:00100000:3.0:1788658613.330055:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811840 00000100:00100000:3.0:1788658613.330116:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788658613.330126:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103811840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658613.330596:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103811840:12345-0@lo:503:mount.lustre.0 Request processed in 470us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658613.330605:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658613.330926:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2402d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788658613.335156:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658613.335399:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658613.335537:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658613.335586:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f44eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788658613.335762:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103811968 00000100:00100000:0.0:1788658613.335773:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103811968 00000100:00100000:0.0:1788658613.335869:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788658613.335880:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103811968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658613.336237:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103811968:12345-0@lo:502:mount.lustre.0 Request processed in 358us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.336253:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658613.337374:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103811968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658613.337860:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788658613.337918:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788658613.337936:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788658613.337975:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788658613.337999:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788658613.338038:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788658613.338058:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788658613.338073:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788658613.338097:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788658613.338114:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788658613.338131:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788658613.338154:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788658613.338171:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788658613.338196:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788658613.338244:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788658613.338292:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788658613.338328:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788658613.339648:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788658613.339707:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788658613.339833:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788658613.339885:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788658613.339956:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788658613.339993:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788658613.340044:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788658613.340081:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788658613.340116:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788658613.340167:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788658613.340223:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788658613.340258:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788658613.340301:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788658613.340333:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788658613.340361:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788658613.340392:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788658613.340446:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788658613.340481:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788658613.340526:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788658613.340557:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788658613.340606:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788658613.340654:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788658613.340906:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788658613.340971:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103812096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658613.341060:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658613.341160:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f44eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658613.342977:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812096 00000100:00100000:2.0:1788658613.342994:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812096 00000100:00100000:3.0:1788658613.344713:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788658613.344856:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fef87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103812096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658613.345276:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fef87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103812096:12345-0@lo:502:mount.lustre.0 Request processed in 425us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.345327:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103812096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658613.345467:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788658613.345492:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788658613.347040:0:15830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788658613.347058:0:15830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e56e6ee3380) 00000020:00000080:0.0:1788658613.347085:0:15830:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788658613.347182:0:15830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56eec4f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658613.347186:0:15830:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56eec4f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658613.347424:0:15830:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56eec4f000 3 00010000:00080000:0.0:1788658613.347467:0:15830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e55c2b9e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.103@tcp at head 00000100:00100000:3.0:1788658613.351938:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1788658613.360542:0:15830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788658613.363593:0:15830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788658613.363645:0:15830:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788658613.363690:0:15830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf657f176650ebd61 00000100:00080000:1.0:1788658613.363706:0:15830:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658613.363715:0:15830:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e55c2b9e000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658613.363779:0:15830:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5700569f80 x1875544103812224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658613.363811:0:15830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788658613.363864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658613.363868:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658613.363881:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658613.363886:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1788658613.363889:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788658613.363893:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183a000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1788658613.363906:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103812224:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658613.363907:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5700569180 x1875544103812480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658613.363950:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103812352:0@lo:400:kworker.0 00000100:00100000:2.0:1788658613.364023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103812608:0@lo:400:kworker.0 00000100:00100000:0.0:1788658613.364584:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658613.364728:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103812480:0@lo:8:kworker.0 00000100:00100000:0.0:1788658613.364764:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658613.364877:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812224 00000100:00100000:0.0:1788658613.364885:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812224 00000100:00100000:0.0:1788658613.364928:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658613.364936:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875544103812224:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788658613.364965:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788658613.365070:0:14420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf657f176650ebd68 00000004:00100000:0.0:1788658613.365089:0:14420:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658613.365127:0:14420:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658613.368522:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.368582:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658613.368596:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103812736:0@lo:400:kworker.0 00000100:00100000:2.0:1788658613.368635:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658613.368843:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658613.368858:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788658613.369069:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812608 00000100:00100000:2.0:1788658613.369077:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812608 00000100:00100000:2.0:1788658613.369115:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788658613.369120:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812736 00000100:00100000:2.0:1788658613.369121:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812736 00000100:00100000:2.0:1788658613.369146:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788658613.369154:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658613.369335:0:15832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788658613.369341:0:15832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788658613.369372:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103812608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658613.369455:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103812608:12345-0@lo:400:kworker.0 Request processed in 292us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.369462:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658613.369481:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658613.369488:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103812736:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788658613.369563:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5700568000 x1875544103812608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658613.369576:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103812608:0@lo:400:kworker.0 00000100:00100000:0.0:1788658613.369701:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875544103812224:12345-0@lo:38:llog_process_th.0 Request processed in 4762us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.369709:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788658613.369731:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5700569f80 x1875544103812224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658613.369739:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812480 00000100:00100000:3.0:1788658613.369740:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788658613.369743:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812480 00000100:00080000:3.0:1788658613.369749:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788658613.369756:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788658613.369761:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:0.0:1788658613.369762:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788658613.369764:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788658613.369770:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103812224:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658613.369840:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875544103812480:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788658613.369903:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875544103812480:12345-0@lo:8:kworker.0 Request processed in 63us (5137us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788658613.369909:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658613.369938:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658613.369943:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658613.369946:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788658613.369949:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103812480:0@lo:8:kworker.0 00000100:00100000:2.0:1788658613.370028:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103812736:12345-0@lo:400:kworker.0 Request processed in 541us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.370035:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788658613.370051:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788658613.370180:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5700569500 x1875544103812736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658613.370190:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103812736:0@lo:400:kworker.0 00000100:00100000:1.0:1788658613.370485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788658613.371070:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1788658613.371357:0:15581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812352 00000100:00100000:2.0:1788658613.371365:0:15581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812352 00000100:00100000:2.0:1788658613.371429:0:15581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658613.371438:0:15581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103812352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658613.371502:0:15581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103812352:12345-0@lo:400:kworker.0 Request processed in 65us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658613.371516:0:15581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658613.371559:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788658613.371574:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103812352:0@lo:400:kworker.0 00000020:01000000:2.0:1788658613.371597:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788658613.371627:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:3.0:1788658613.372245:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788658613.373366:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.373383:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658613.373476:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658613.373479:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658613.373480:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658613.373481:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658613.373483:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658613.373484:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658613.373486:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658613.373488:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658613.373489:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658613.373495:0:15819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788658613.373497:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658613.373499:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658613.373500:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658613.373501:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658613.373502:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658613.373503:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658613.373504:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658613.373505:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658613.373506:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658613.373540:0:15819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788658613.373565:0:15819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103812864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658613.373645:0:15819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.373860:0:15819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9765b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658613.373930:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812864 00000100:00100000:3.0:1788658613.373937:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812864 00000100:00100000:3.0:1788658613.373993:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658613.374003:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fef87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:15819:x1875544103812864:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788658613.374030:0:14412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788658613.374046:0:14412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788658613.401155:0:14412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788658613.401177:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788658613.401276:0:14434:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788658613.401282:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788658613.401308:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.401328:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebc42 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.401338:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.401385:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ebc42 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658613.401402:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ebc42 expref: 19 pid: 14413 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658613.401425:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875544103812992:0@lo:104: 00000100:00100000:2.0:1788658613.401504:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658613.401558:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1602cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658613.401612:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103812992 00000100:00100000:0.0:1788658613.401621:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103812992 00000100:00100000:0.0:1788658613.401708:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658613.401719:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7221c739-be00-4743-a572-f61de58b82dc+3:14434:x1875544103812992:12345-0@lo:104: 00010000:00010000:0.0:1788658613.401746:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.401804:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658613.401811:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7221c739-be00-4743-a572-f61de58b82dc+3:14434:x1875544103812992:12345-0@lo:104: Request processed in 94us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.401818:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788658613.401842:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658613.401848:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.401854:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658613.401858:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.401867:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658613.401874:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658613.401895:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658613.401926:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.401932:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658613.401963:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.401971:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007ee000/0xf657f176650ebc42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebc49 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.401986:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658613.401988:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658613.401990:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658613.402006:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658613.402016:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103813120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658613.402047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658613.402073:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103813120 00000100:00100000:0.0:1788658613.402077:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103813120 00010000:00010000:0.0:1788658613.402094:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebc42 expref: 20 pid: 14413 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658613.402115:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658613.402121:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+20:3305:x1875544103813120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658613.402131:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658613.402135:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebc42 expref: 20 pid: 14413 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402145:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ebc42 expref: 20 pid: 14413 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402169:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402177:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658613.402191:0:14405:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003991086s 00010000:00010000:0.0:1788658613.402195:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402201:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402208:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402213:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402218:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658613.402221:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402228:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402236:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402244:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658613.402272:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+20:3305:x1875544103813120:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.402284:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658613.402324:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103813120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658613.402350:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891a200/0xf657f176650ebc49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ebc42 expref: 19 pid: 14413 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658613.402359:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14434:1875544103812992:0@lo:104: 00010000:00010000:0.0:1788658613.402375:0:14434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402384:0:14434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402391:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658613.402396:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891a600/0xf657f176650ebd6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658613.435999:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fef87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+18:15819:x1875544103812864:12345-0@lo:253:mount.lustre.0 Request processed in 61982us (62338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658613.436018:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658613.436319:0:15819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7221c739-be00-4743-a572-f61de58b82dc:15819:1875544103812864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788658613.436336:0:15819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788658613.436339:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658613.436342:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788658613.436343:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658613.436345:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658613.436346:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658613.436347:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658613.436349:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658613.436351:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658613.436353:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788658613.436367:0:15819:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788658613.455135:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658613.455338:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658613.455520:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658613.456043:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658613.456192:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658613.456456:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788658613.464893:0:15819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788658613.469497:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788658613.553615:0:15819:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788658613.553626:0:15819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788658613.553661:0:15819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658613.553843:0:15819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658613.553862:0:15819:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788658613.553894:0:15819:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1788658614.173423:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103813248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658614.173505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658614.173598:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103813248 00000100:00100000:0.0:1788658614.173605:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103813248 00000100:00100000:0.0:1788658614.173659:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658614.173683:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103813248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658614.173725:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658614.173881:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103813248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658614.173889:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658614.173938:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103813248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788658614.492946:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788658614.623934:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788658614.623944:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56d00a1000 from 8 10000000:01000000:1.0:1788658614.623950:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658614.624004:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658614.624017:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658614.624029:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658614.624054:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103813376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658614.624128:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658614.624193:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6fb4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658614.624277:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103813376 00000100:00100000:3.0:1788658614.624286:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103813376 00000100:00100000:3.0:1788658614.624348:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658614.624359:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fef84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103813376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658614.624375:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658614.624393:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29df600/0xf657f176650ebd7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebd76 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658614.624424:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29df600/0xf657f176650ebd7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebd76 expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658614.624436:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29df600/0xf657f176650ebd7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebd76 expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658614.624457:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29df600, rc 0) 00000100:00100000:3.0:1788658614.624520:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fef84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103813376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658614.624526:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658614.624576:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103813376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658614.624593:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658614.624604:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658614.624684:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103813504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658614.624720:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658614.624747:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658614.625024:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103813504 00000100:00100000:0.0:1788658614.625031:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103813504 00000100:00100000:0.0:1788658614.625057:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788658614.625065:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103813504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788658614.625082:0:14412:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658614.625103:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658614.625106:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788658614.625187:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103813504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658614.625195:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658614.630798:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103813504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788658614.630908:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658614.630919:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658614.630930:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658615.517657:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658615.965288:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788658616.545758:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658617.577495:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.590354:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658618.780830:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658618.780837:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658618.780841:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658618.780880:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183a000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658618.780905:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e570056a680 x1875544103813888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658618.781194:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103813760:0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.781347:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658618.781407:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788658618.781414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103813632:0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.781447:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658618.781469:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103814272:0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.781498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658618.781658:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103813888:0@lo:8:kworker.0 00000100:00100000:3.0:1788658618.781706:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658618.781772:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103813760 00000100:00100000:3.0:1788658618.781789:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103813760 00000100:00100000:3.0:1788658618.781858:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103813888 00000100:00100000:3.0:1788658618.781861:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103813888 00000100:00100000:3.0:1788658618.781880:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658618.781890:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103813760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658618.782437:0:15581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658618.782445:0:15581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3303:x1875544103813888:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788658618.782474:0:15581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000100:00100000:1.0:1788658618.782660:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103814016:0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.782715:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658618.782740:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658618.782746:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103814144:0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.782766:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658618.782800:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103813632 00000100:00100000:1.0:1788658618.782805:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103813632 00000100:00100000:1.0:1788658618.782834:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658618.782840:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:3307:x1875544103813632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.782894:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:3307:x1875544103813632:12345-0@lo:400:kworker.0 Request processed in 52us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658618.782901:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000020:00000080:2.0:1788658618.783449:0:15581:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ebd84 00002000:00100000:2.0:1788658618.783468:0:15581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e56fefaf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788658618.783474:0:15581:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788658618.783477:0:15581:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788658618.783662:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103813760:12345-0@lo:400:kworker.0 Request processed in 1770us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658618.783682:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788658618.783731:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658618.785249:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814272 00000100:00100000:1.0:1788658618.785260:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814272 00000100:00100000:1.0:1788658618.785655:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814016 00000100:00100000:1.0:1788658618.785660:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814016 00000100:00100000:1.0:1788658618.785702:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814144 00000100:00100000:1.0:1788658618.785706:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814144 00000100:00100000:1.0:1788658618.785726:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658618.785735:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103814272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.785810:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103814272:12345-0@lo:400:kworker.0 Request processed in 76us (4310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658618.785817:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658618.785832:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658618.785838:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103814016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658618.786184:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658618.786195:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103814144:12345-0@lo:400:kworker.0 00002000:00080000:2.0:1788658618.786722:0:15581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788658618.786754:0:15581:0:(import.c:65:import_set_state_nolock()) ffff9e56fefaa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658618.786812:0:15581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875544103813888:12345-0@lo:8:kworker.0 Request processed in 4366us (5105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658618.786821:0:15581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658618.787275:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103814016:12345-0@lo:400:kworker.0 Request processed in 1426us (4547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658618.787283:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788658618.787363:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700568700 x1875544103814016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658618.787379:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103814016:0@lo:400:kworker.0 00000100:00100000:3.0:1788658618.787748:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103814144:12345-0@lo:400:kworker.0 Request processed in 1555us (4979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658618.787756:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788658618.787799:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788658618.787820:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570056b800 x1875544103814144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658618.787830:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103814144:0@lo:400:kworker.0 00010000:00080000:3.0:1788658618.787859:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e570056a680 x1875544103813888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658618.787871:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788658618.787880:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788658618.787886:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788658618.787888:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788658618.787908:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788658618.787913:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103813888:0@lo:8:kworker.0 00000004:00080000:3.0:1788658618.788295:0:14443:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788658618.788319:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875544103814528:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788658618.788357:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658618.788379:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6fb4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658618.788396:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814528 00000100:00100000:3.0:1788658618.788401:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814528 00000100:00100000:3.0:1788658618.788442:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658618.788450:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14443:x1875544103814528:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788658618.793100:0:15101:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788658618.793111:0:15101:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788658618.793117:0:15101:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000004:00080000:0.0:1788658618.794561:0:14442:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788658618.794994:0:14442:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 509934327941ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788658618.797315:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103814400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658618.797393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658618.797448:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103813632:0@lo:400:kworker.0 00010000:00080000:1.0:1788658618.797465:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5700568380 x1875544103814272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658618.797477:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103814272:0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.797489:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103813760:0@lo:400:kworker.0 00000100:00100000:1.0:1788658618.797737:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814400 00000100:00100000:1.0:1788658618.797744:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814400 00000100:00100000:1.0:1788658618.797803:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658618.797812:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875544103814400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658618.797847:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658618.797893:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875544103814400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658618.797900:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788658618.798150:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56fefd9880 x1875544103814400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658618.798167:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103814400:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788658618.801229:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788658618.828352:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.828364:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.828382:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788658618.828387:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.828395:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.828415:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.828427:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.828435:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.828464:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.828477:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.828482:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.828490:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dec00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.828495:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.828504:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658618.829872:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658618.829883:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.829896:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788658618.829900:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658618.829905:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.829919:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.829956:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.829964:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.829982:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658618.829996:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788658618.830491:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658618.830498:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.830508:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788658618.830512:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658618.830516:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.830526:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.830534:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.830542:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.830561:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.831973:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.831987:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebd8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832011:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.832015:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832022:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.832027:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832049:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832060:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832067:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007473e902/0xf657f176650ebd99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832080:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.832082:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.832084:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.832167:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.832174:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832182:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.832185:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.832193:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.835653:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.835704:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffff1689/0xf657f176650ebd92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.835743:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.835746:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.835748:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.835753:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.835755:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658618.843605:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.843618:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843636:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788658618.843641:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.843658:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843698:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843709:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843717:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843750:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.843766:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.843771:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843778:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfa00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.843783:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843792:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843809:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843816:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.843835:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.843836:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.843838:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658618.899335:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788658618.908407:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.908423:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.908441:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788658618.908452:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.908459:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.908478:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.908489:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.908497:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.908898:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658618.909415:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.909424:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.909436:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfa00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.909441:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.909454:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.909473:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.909480:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004177367e/0xf657f176650ebda7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.909500:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.909502:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.909504:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788658618.913915:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788658618.914073:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.914084:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914103:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788658618.914108:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.914115:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914130:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914140:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914157:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914175:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.914187:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.914193:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914200:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dec00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.914205:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914216:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914235:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914244:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9485caa/0xf657f176650ebdae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.914262:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.914264:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.914266:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658618.917658:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.917701:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.917722:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788658618.917727:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.917734:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.917750:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.917762:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.917771:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.917790:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.917804:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.918197:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.918208:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dea00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.918213:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.918224:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.918254:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.918263:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099acae39/0xf657f176650ebdb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.918376:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.918379:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.918382:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658618.919462:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.919473:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.919490:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788658618.919494:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.919500:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.919512:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.919608:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.919618:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.919689:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658618.919689:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.919699:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.919711:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfc00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.919724:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.919735:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.919752:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.919759:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083ab8351/0xf657f176650ebdbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.919783:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.919786:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.919789:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658618.920511:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.920593:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.920604:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788658618.920608:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.920612:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.920624:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.920633:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.920641:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.920691:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658618.920755:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.920762:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.920771:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfe00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.920775:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.920785:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.920798:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.920815:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035ab002a/0xf657f176650ebdc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.920831:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.920834:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.920835:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658618.921398:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.921406:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.921415:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788658618.921425:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.921430:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.921439:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.921448:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.921456:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.921479:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658618.921552:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.921558:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.921567:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29de200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.921570:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.921578:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.921590:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.921597:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004254cbb0/0xf657f176650ebdca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.921619:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.921622:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.921624:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658618.922085:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658618.922092:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.922102:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788658618.922106:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658618.922110:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.922120:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.922127:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.922141:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.922163:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658618.922225:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.922232:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.922241:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29de400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.922246:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.922254:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.922266:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.922274:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f0e147/0xf657f176650ebdd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.922288:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.922290:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.922291:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.923316:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.923326:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.923339:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.923343:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.923348:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.923371:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.923380:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.923387:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.923407:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.923431:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.923439:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.923448:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.923452:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.923463:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.923478:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.923485:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebdd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658618.923901:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.923907:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.923917:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.923921:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.924139:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924154:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924163:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924182:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924200:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658618.924212:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658618.924217:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924224:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79e00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658618.924229:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924237:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924249:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924256:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc004a72/0xf657f176650ebddf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924270:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.924272:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.924274:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.924604:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.924607:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.924610:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.924756:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.924770:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924780:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.924783:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.924788:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924798:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924807:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924814:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.924839:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.924896:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.924909:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.924918:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.924921:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.924930:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.924942:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.924949:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fed843b/0xf657f176650ebde6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.924973:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.924975:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.924976:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.925477:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.925484:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.925493:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.925496:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.925500:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.925509:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.925526:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.925532:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.925593:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788658618.926116:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.926123:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.926133:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.926136:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.926140:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.926149:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.926158:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.926165:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927144:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658618.927154:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927165:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.927170:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927193:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927209:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927216:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d6905f0/0xf657f176650ebded lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927239:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.927243:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927249:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.927251:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927259:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927268:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.927275:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.927277:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.927284:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.930793:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658618.930809:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d753021/0xf657f176650ebdf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658618.932509:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.932522:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.932540:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.932545:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.932552:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.932569:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.932580:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.932588:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.934129:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.934145:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.934159:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.934164:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.934177:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.934197:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.934226:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.934228:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.934230:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.935140:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788658618.935153:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.935153:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000224f4e57/0xf657f176650ebdfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658618.936352:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658618.936362:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.936377:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788658618.936381:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658618.936388:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.936401:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.936417:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.936425:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.936447:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658618.936901:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658618.936907:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.936916:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788658618.936920:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658618.936924:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.937127:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658618.937135:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.937143:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658618.937147:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.937156:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.937175:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.937183:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e09d79df/0xf657f176650ebe02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.937201:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.937203:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.937204:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.937270:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937280:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937287:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937315:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658618.937325:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658618.937329:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937336:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658618.937339:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937347:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937356:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937364:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004639ec24/0xf657f176650ebe09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658618.937376:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.937378:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658618.937379:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.939572:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.939587:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.939606:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.939619:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.939627:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.939645:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.939718:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.939725:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.939749:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.939901:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.939910:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.939919:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.939923:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.939943:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940163:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940171:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7e76714/0xf657f176650ebe10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940195:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.940198:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.940201:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.940290:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.940297:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940306:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.940310:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.940314:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940324:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940332:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940347:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940373:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.940426:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.940433:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940440:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.940444:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940453:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940465:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940485:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015648c6d/0xf657f176650ebe17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.940503:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.940504:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.940506:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.940812:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.940818:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940826:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.940830:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.940834:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940844:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940851:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940857:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.940885:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.941016:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.941022:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941031:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.941035:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941044:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941057:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941065:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b9c123/0xf657f176650ebe1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941082:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.941084:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.941086:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.941278:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.941284:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941298:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.941301:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.941305:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941315:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941323:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941330:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941353:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.941607:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.941613:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941622:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.941627:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941636:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941660:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941687:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023bf75b7/0xf657f176650ebe25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941708:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.941710:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.941713:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.941802:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.941807:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941815:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.941818:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.941822:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941830:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941847:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941854:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.941874:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.941898:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.941905:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941913:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.941916:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941938:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941950:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941973:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000babe0c2d/0xf657f176650ebe2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.941993:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.941996:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.941998:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.942291:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.942297:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.942306:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.942309:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.942313:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.942322:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.942330:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.942337:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.942372:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.942604:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.942610:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.942618:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8e00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.942622:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.942632:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.942644:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.942693:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cf1fa2f/0xf657f176650ebe33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.942709:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.942711:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.942713:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.950877:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.950893:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.950911:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.950916:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.950922:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.950953:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.950963:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.950970:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.950994:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.951101:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.951110:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951119:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.951124:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951134:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951152:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951161:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be8f1001/0xf657f176650ebe3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951186:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.951189:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.951191:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.951555:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.951562:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.951570:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.951579:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.951584:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.951595:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.951603:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.951609:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.951631:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658618.951712:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658618.951718:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951727:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658618.951731:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951742:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951756:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951764:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067631f4f/0xf657f176650ebe41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658618.951780:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.951783:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658618.951785:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658618.952100:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658618.952106:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.952115:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788658618.952118:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658618.952122:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.952132:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.952141:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.952154:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.952175:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788658618.952344:0:15101:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788658618.952451:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14443:x1875544103814528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 163997us (164089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658618.952464:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658618.953151:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875544103814528:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788658618.953167:0:14443:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788658618.953212:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875544103814656:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788658618.953250:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658618.953337:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f41180 going to sleep for 11 seconds 00010000:00010000:0.0:1788658618.953351:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658618.953357:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.953367:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658618.953370:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.953380:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.953420:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.953427:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d26cd241/0xf657f176650ebe48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658618.953447:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.953449:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658618.953450:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658618.954206:0:15581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814656 00000100:00100000:1.0:1788658618.954217:0:15581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814656 00000100:00100000:1.0:1788658618.954272:0:15581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658618.954283:0:15581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:14443:x1875544103814656:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788658618.954332:0:15581:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1788658618.965258:0:15581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14443:x1875544103814656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10965us (11996us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788658618.965274:0:15581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658618.965722:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14443:1875544103814656:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788658618.965739:0:14443:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788658619.303437:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658619.303462:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103814784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658619.303530:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658619.303857:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814784 00000100:00100000:0.0:1788658619.303865:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814784 00000100:00100000:0.0:1788658619.303914:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658619.303923:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103814784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658619.303960:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658619.304042:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103814784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658619.304049:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658619.304116:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103814784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788658619.612806:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658619.787225:0:16179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788658620.639804:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658621.663931:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658622.332391:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.333005:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076557440 00000100:00100000:3.0:1788658622.333016:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076557440 00000100:00100000:3.0:1788658622.333099:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:3.0:1788658622.333108:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1875544076557440:12345-192.168.202.3@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788658622.333136:0:14414:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b9e0e608-bdd7-47a4-be53-67c24230139c@192.168.202.3@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1788658622.333173:0:14414:0:(genops.c:1385:class_connect()) connect: client b9e0e608-bdd7-47a4-be53-67c24230139c, cookie 0xf657f176650ebe4f 00000100:00080000:3.0:1788658622.333322:0:14414:0:(import.c:65:import_set_state_nolock()) ffff9e56eec02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658622.333402:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+5:2350:x1875544076557440:12345-192.168.202.3@tcp:250:mount.lustre.0 Request processed in 294us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.333411:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:1.0:1788658622.340705:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658622.341008:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076557568 00000100:00100000:2.0:1788658622.341034:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076557568 00000100:00100000:2.0:1788658622.341092:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:2.0:1788658622.341104:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb261450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+5:13775:x1875544076557568:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658622.341124:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658622.341145:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891a200/0xf657f176650ebe56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b129 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.341180:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891a200/0xf657f176650ebe56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b129 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.341194:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891a200/0xf657f176650ebe56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b129 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.341202:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a200, rc 0) 00000100:00100000:2.0:1788658622.341276:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb261450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+6:13775:x1875544076557568:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 174us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.341283:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:2.0:1788658622.350403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.350497:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076557696 00000100:00100000:3.0:1788658622.350521:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076557696 00000100:00100000:3.0:1788658622.350585:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:3.0:1788658622.350596:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+6:13775:x1875544076557696:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788658622.351024:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+6:13775:x1875544076557696:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 429us (630us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658622.351034:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:2.0:1788658622.354752:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.354868:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076557824 00000100:00100000:1.0:1788658622.354881:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076557824 00000100:00100000:1.0:1788658622.354954:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:1.0:1788658622.354967:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+6:13775:x1875544076557824:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658622.354988:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658622.355027:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1678800/0xf657f176650ebe5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b130 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.355065:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678800/0xf657f176650ebe5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b130 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.355081:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1678800/0xf657f176650ebe5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b130 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.355091:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678800, rc 0) 00000100:00100000:1.0:1788658622.355161:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+7:13775:x1875544076557824:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 196us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.355169:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:1.0:1788658622.364926:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.365085:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076557952 00000100:00100000:3.0:1788658622.365097:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076557952 00000100:00100000:3.0:1788658622.365149:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:3.0:1788658622.365156:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+7:13775:x1875544076557952:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788658622.365606:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13775:x1875544076557952:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 446us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.365616:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:3.0:1788658622.374699:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658622.374916:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558080 00000100:00100000:2.0:1788658622.374929:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558080 00000100:00100000:2.0:1788658622.374997:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:2.0:1788658622.375009:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13775:x1875544076558080:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788658622.375359:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13775:x1875544076558080:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 351us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.375368:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:2.0:1788658622.378564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.378718:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558208 00000100:00100000:3.0:1788658622.378733:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558208 00000100:00100000:3.0:1788658622.378916:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:3.0:1788658622.378927:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13794:x1875544076558208:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658622.379312:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13794:x1875544076558208:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 385us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.379327:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:0.0:1788658622.419010:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658622.419145:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558336 00000100:00100000:2.0:1788658622.419159:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558336 00000100:00100000:2.0:1788658622.419226:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:2.0:1788658622.419237:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13794:x1875544076558336:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658622.419588:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13794:x1875544076558336:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 352us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.419597:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:2.0:1788658622.423137:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.423258:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558464 00000100:00100000:3.0:1788658622.423269:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558464 00000100:00100000:3.0:1788658622.423327:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:3.0:1788658622.423338:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+8:13775:x1875544076558464:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788658622.423355:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658622.423372:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dea00/0xf657f176650ebe64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b15a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.423402:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dea00/0xf657f176650ebe64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b15a expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.423414:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dea00/0xf657f176650ebe64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b15a expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.423424:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dea00, rc 0) 00000100:00100000:3.0:1788658622.423494:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+9:13775:x1875544076558464:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 158us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.423501:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:3.0:1788658622.433787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.433994:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558592 00000100:00100000:1.0:1788658622.434006:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558592 00000100:00100000:1.0:1788658622.434069:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:1.0:1788658622.434080:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+9:13775:x1875544076558592:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788658622.434109:0:14412:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788658622.434132:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788658622.434136:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788658622.434139:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788658622.434142:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788658622.439497:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+9:13775:x1875544076558592:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 5406us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.439513:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:2.0:1788658622.443720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.443823:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558720 00000100:00100000:1.0:1788658622.443834:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558720 00000100:00100000:1.0:1788658622.443889:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:1.0:1788658622.443915:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+9:13775:x1875544076558720:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658622.443935:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658622.443955:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b161 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.443984:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.443995:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.444004:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678600, rc 0) 00000100:00100000:1.0:1788658622.444067:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13775:x1875544076558720:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 154us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.444074:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:3.0:1788658622.448343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.450250:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558848 00000100:00100000:1.0:1788658622.450270:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558848 00000100:00100000:1.0:1788658622.450356:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:1.0:1788658622.450368:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13775:x1875544076558848:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658622.450773:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13775:x1875544076558848:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 405us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.450782:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:0.0:1788658622.453034:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.456413:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076558976 00000100:00100000:1.0:1788658622.456432:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076558976 00000100:00100000:1.0:1788658622.456529:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:1.0:1788658622.456544:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13775:x1875544076558976:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788658622.457577:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13775:x1875544076558976:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 1031us (4545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.457599:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:2.0:1788658622.466801:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.467289:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076559104 00000100:00100000:1.0:1788658622.467302:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076559104 00000100:00100000:1.0:1788658622.467360:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:1.0:1788658622.467371:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13797:x1875544076559104:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658622.467755:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13797:x1875544076559104:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 382us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.467763:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:3.0:1788658622.493389:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.493492:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076559232 00000100:00100000:1.0:1788658622.493504:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076559232 00000100:00100000:1.0:1788658622.493572:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:1.0:1788658622.493583:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13797:x1875544076559232:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658622.493926:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13797:x1875544076559232:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 343us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.493937:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:0.0:1788658622.513764:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658622.516456:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076559360 00000100:00100000:2.0:1788658622.516475:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076559360 00000100:00100000:2.0:1788658622.516567:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1788658622.516579:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1875544076559360:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658622.516629:0:15832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 59fc9cf2-29f7-4afb-a889-1aea3676cd57@192.168.202.3@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1788658622.516735:0:15832:0:(genops.c:1385:class_connect()) connect: client 59fc9cf2-29f7-4afb-a889-1aea3676cd57, cookie 0xf657f176650ebe72 00000004:00100000:2.0:1788658622.516778:0:15832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788658622.516788:0:15832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788658622.568513:0:15832:0:(import.c:65:import_set_state_nolock()) ffff9e56eec06800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658622.568924:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2350:x1875544076559360:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 52345us (55175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.568937:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1788658622.583048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658622.583084:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.583175:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076559488 00000100:00100000:3.0:1788658622.583202:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076559488 00000100:00100000:3.0:1788658622.583281:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076559616 00000100:00100000:3.0:1788658622.583284:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076559616 00000100:00100000:3.0:1788658622.583306:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1788658622.583316:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:0:x1875544076559488:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658622.583366:0:14419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788658622.583460:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:0:x1875544076559488:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 145us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.583468:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1788658622.583487:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658622.583494:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:13775:x1875544076559616:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658622.583505:0:14419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788658622.583521:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:13775:x1875544076559616:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.583525:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00080000:0.0:1788658622.583704:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658622.593889:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.594386:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076559744 00000100:00100000:3.0:1788658622.594397:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076559744 00000100:00100000:3.0:1788658622.594473:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658622.594485:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:13775:x1875544076559744:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788658622.594580:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:13775:x1875544076559744:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 98us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.594585:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658622.598001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658622.598054:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658622.599788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658622.600448:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560128 00000100:00100000:3.0:1788658622.600460:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560128 00000100:00100000:3.0:1788658622.600530:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1788658622.600542:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:13775:x1875544076560128:12345-192.168.202.3@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788658622.602097:0:14421:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1452us 00000100:00100000:1.0:1788658622.604411:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076559872 00000100:00100000:1.0:1788658622.604430:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076559872 00000100:00100000:1.0:1788658622.604500:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560000 00000100:00100000:1.0:1788658622.604505:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560000 00000100:00100000:1.0:1788658622.604527:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658622.604536:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875544076559872:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788658622.604566:0:15100:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 59fc9cf2-29f7-4afb-a889-1aea3676cd57@192.168.202.3@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1788658622.604597:0:15100:0:(genops.c:1385:class_connect()) connect: client 59fc9cf2-29f7-4afb-a889-1aea3676cd57, cookie 0xf657f176650ebe79 00002000:00100000:1.0:1788658622.604609:0:15100:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 59fc9cf2-29f7-4afb-a889-1aea3676cd57/ffff9e55c28f3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788658622.604642:0:15100:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788658622.604873:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1788658622.604880:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875544076560000:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658622.604903:0:15101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 59fc9cf2-29f7-4afb-a889-1aea3676cd57@192.168.202.3@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1788658622.604920:0:15101:0:(genops.c:1385:class_connect()) connect: client 59fc9cf2-29f7-4afb-a889-1aea3676cd57, cookie 0xf657f176650ebe80 00002000:00100000:2.0:1788658622.604926:0:15101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 59fc9cf2-29f7-4afb-a889-1aea3676cd57/ffff9e56db3f6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658622.604947:0:15101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658622.605113:0:15101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788658622.605149:0:15101:0:(import.c:65:import_set_state_nolock()) ffff9e56db3f3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658622.605233:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2350:x1875544076560000:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 351us (7178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.605241:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00002000:00080000:1.0:1788658622.605729:0:15100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788658622.605747:0:15100:0:(import.c:65:import_set_state_nolock()) ffff9e55c28f2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658622.606904:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2350:x1875544076559872:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 2360us (8908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.606917:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000004:00200000:3.0:1788658622.626913:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788658622.627063:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:13775:x1875544076560128:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 26515us (27279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.627076:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00010000:00010000:3.0:1788658622.685028:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658622.866437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658622.866798:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560256 00000100:00100000:1.0:1788658622.866809:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560256 00000100:00100000:1.0:1788658622.866883:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658622.866894:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:13818:x1875544076560256:12345-192.168.202.3@tcp:101:mkdir.0 00010000:00010000:1.0:1788658622.866921:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658622.866999:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679c00/0xf657f176650ebe87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b18b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.867090:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650ebe8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.867107:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650ebe8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.867121:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650ebe8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658622.867160:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658622.867164:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658622.867203:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650ebe8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.867244:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679c00/0xf657f176650ebe87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b18b expref: 8 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.867279:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650ebe8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b18b expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.867288:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:1.0:1788658622.867291:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658622.867295:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1679000, rc 0) 00000100:00100000:1.0:1788658622.867362:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:13818:x1875544076560256:12345-192.168.202.3@tcp:101:mkdir.0 Request processed in 470us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658622.867370:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00010000:00010000:3.0:1788658623.708833:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658623.901407:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103815296:0@lo:400:kworker.0 00000100:00100000:3.0:1788658623.901495:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658623.901570:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788658623.901577:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103814912:0@lo:400:kworker.0 00000100:00100000:2.0:1788658623.901586:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815296 00000100:00100000:2.0:1788658623.901594:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815296 00000100:00100000:3.0:1788658623.901606:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658623.901630:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103815424:0@lo:400:kworker.0 00000100:00100000:2.0:1788658623.901640:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658623.901649:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658623.901649:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103815296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658623.901697:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103814912 00000100:00100000:3.0:1788658623.901701:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103814912 00000100:00100000:2.0:1788658623.901730:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103815296:12345-0@lo:400:kworker.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658623.901737:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658623.901740:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788658623.901746:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:3304:x1875544103814912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658623.901750:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815424 00000100:00100000:2.0:1788658623.901753:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815424 00000100:00100000:3.0:1788658623.901777:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:3304:x1875544103814912:12345-0@lo:400:kworker.0 Request processed in 31us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658623.901780:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658623.901783:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788658623.901785:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658623.901812:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103815424:12345-0@lo:400:kworker.0 Request processed in 27us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658623.901817:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658623.901829:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56ff644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103814912:0@lo:400:kworker.0 00000100:00080000:2.0:1788658623.901830:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658623.901843:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103815424:0@lo:400:kworker.0 00000100:00100000:3.0:1788658623.901853:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103815296:0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.905618:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103815040:0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.905730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658623.905773:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103815552:0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.905801:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658623.905833:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788658623.905840:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103815168:0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.905865:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658623.905882:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103815680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658623.905905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658623.906043:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815680 00000100:00100000:1.0:1788658623.906054:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815680 00000100:00080000:2.0:1788658623.906090:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658623.906118:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658623.906128:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103815680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658623.906170:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815040 00000100:00100000:2.0:1788658623.906173:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815040 00002000:00000024:1.0:1788658623.906177:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788658623.906188:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658623.906216:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815168 00000100:00100000:2.0:1788658623.906219:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815168 00000100:00100000:1.0:1788658623.906221:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103815680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658623.906234:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658623.906240:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658623.906252:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103815040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.906260:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815552 00000100:00100000:1.0:1788658623.906263:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815552 00000100:00100000:2.0:1788658623.906288:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103815040:12345-0@lo:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658623.906292:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658623.906295:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658623.906297:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103815552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658623.906305:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658623.906311:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103815168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.906326:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103815552:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658623.906332:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875544103815168:12345-0@lo:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658623.906332:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658623.906337:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788658623.906364:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658623.906380:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103815168:0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.906395:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103815680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658623.906404:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103815040:0@lo:400:kworker.0 00000100:00100000:1.0:1788658623.906414:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103815552:0@lo:400:kworker.0 00000001:00080000:1.0:1788658624.073966:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788658624.073984:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59fc9cf2-29f7-4afb-a889-1aea3676cd57 00000100:00100000:0.0:1788658624.412960:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658624.412985:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103815808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658624.413377:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658624.413469:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815808 00000100:00100000:1.0:1788658624.413478:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815808 00000100:00100000:1.0:1788658624.413528:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658624.413539:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103815808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658624.413579:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658624.413650:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103815808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658624.413658:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658624.413786:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103815808:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788658624.500050:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59fc9cf2-29f7-4afb-a889-1aea3676cd57 00010000:00010000:0.0:1788658624.733381:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658624.905300:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658624.905402:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560384 00000100:00100000:2.0:1788658624.905412:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560384 00000100:00100000:2.0:1788658624.905499:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1788658624.905509:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:13870:x1875544076560384:12345-192.168.202.3@tcp:41:lfs.0 00000004:00000024:2.0:1788658624.905557:0:15833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788658624.905697:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:13870:x1875544076560384:12345-192.168.202.3@tcp:41:lfs.0 Request processed in 187us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658624.905704:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00080000:0.0:1788658624.905869:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658624.910412:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658624.910569:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560512 00000100:00100000:1.0:1788658624.910596:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560512 00000100:00100000:1.0:1788658624.910702:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1788658624.910713:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:13870:x1875544076560512:12345-192.168.202.3@tcp:13:lfs.0 00002000:00000024:1.0:1788658624.910740:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658624.910819:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:13870:x1875544076560512:12345-192.168.202.3@tcp:13:lfs.0 Request processed in 108us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658624.910826:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00080000:0.0:1788658624.910931:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658624.918984:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658624.919153:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560640 00000100:00100000:1.0:1788658624.919164:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560640 00000100:00100000:1.0:1788658624.919236:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:1.0:1788658624.919247:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:13870:x1875544076560640:12345-192.168.202.3@tcp:13:lfs.0 00002000:00000024:1.0:1788658624.919302:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658624.919392:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:13870:x1875544076560640:12345-192.168.202.3@tcp:13:lfs.0 Request processed in 147us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658624.919400:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00080000:0.0:1788658624.919535:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658625.070169:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658625.070319:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560768 00000100:00100000:0.0:1788658625.070330:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560768 00000100:00100000:0.0:1788658625.070439:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:0.0:1788658625.070450:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+10:13903:x1875544076560768:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658625.070468:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658625.070485:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57021d8400/0xf657f176650ebe95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b192 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.070512:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57021d8400/0xf657f176650ebe95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b192 expref: 11 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.070523:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57021d8400/0xf657f176650ebe95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b192 expref: 11 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.070549:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d8400, rc 0) 00000100:00100000:0.0:1788658625.070620:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13903:x1875544076560768:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 171us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.070627:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:3.0:1788658625.081038:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658625.081210:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076560896 00000100:00100000:1.0:1788658625.081222:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076560896 00000100:00100000:1.0:1788658625.081303:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:1.0:1788658625.081316:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13903:x1875544076560896:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658625.081723:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13903:x1875544076560896:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 407us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.081732:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:1.0:1788658625.091342:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658625.091455:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561024 00000100:00100000:0.0:1788658625.091467:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561024 00000100:00100000:0.0:1788658625.091567:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:0.0:1788658625.091580:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13903:x1875544076561024:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788658625.091863:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13903:x1875544076561024:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 285us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.091871:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:0.0:1788658625.098228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.099980:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561152 00000100:00100000:3.0:1788658625.099995:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561152 00000100:00100000:3.0:1788658625.100064:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:3.0:1788658625.100075:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13909:x1875544076561152:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658625.100406:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13909:x1875544076561152:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 331us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.100415:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:3.0:1788658625.116036:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658625.116264:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561280 00000100:00100000:0.0:1788658625.116274:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561280 00000100:00100000:0.0:1788658625.116333:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:0.0:1788658625.116344:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13909:x1875544076561280:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658625.116636:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13909:x1875544076561280:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 293us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.116644:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:0.0:1788658625.120528:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658625.120805:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561408 00000100:00100000:1.0:1788658625.120816:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561408 00000100:00100000:1.0:1788658625.120874:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:1.0:1788658625.120884:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13903:x1875544076561408:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658625.120915:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658625.120936:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c1678400/0xf657f176650ebe9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b1bc expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.121127:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c1678400/0xf657f176650ebe9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1bc expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.121142:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c1678400/0xf657f176650ebe9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1bc expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.121151:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c1678400, rc 0) 00000100:00100000:1.0:1788658625.121211:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13903:x1875544076561408:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 328us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.121219:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:1.0:1788658625.124321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.124414:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561536 00000100:00100000:3.0:1788658625.124425:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561536 00000100:00100000:3.0:1788658625.124486:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:3.0:1788658625.124498:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13903:x1875544076561536:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788658625.124523:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788658625.124545:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788658625.124549:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788658625.124552:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788658625.124555:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788658625.126369:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13903:x1875544076561536:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 1866us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.126381:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:1.0:1788658625.130707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658625.131356:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561664 00000100:00100000:2.0:1788658625.131368:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561664 00000100:00100000:2.0:1788658625.131443:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:2.0:1788658625.131455:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13903:x1875544076561664:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658625.131476:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658625.131494:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b1c3 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.131552:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.131565:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.131575:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ba00, rc 0) 00000100:00100000:2.0:1788658625.131637:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13903:x1875544076561664:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 184us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.131645:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:1.0:1788658625.135279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658625.135365:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561792 00000100:00100000:0.0:1788658625.135389:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561792 00000100:00100000:0.0:1788658625.135446:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:0.0:1788658625.135458:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13903:x1875544076561792:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788658625.135793:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13903:x1875544076561792:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 337us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.135802:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:2.0:1788658625.138166:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658625.138701:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076561920 00000100:00100000:0.0:1788658625.138715:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076561920 00000100:00100000:0.0:1788658625.138837:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:0.0:1788658625.138849:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff52d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13903:x1875544076561920:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788658625.139140:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff52d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13903:x1875544076561920:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 293us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.139148:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:1.0:1788658625.148879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658625.149244:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562048 00000100:00100000:2.0:1788658625.149264:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562048 00000100:00100000:2.0:1788658625.149319:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:2.0:1788658625.149329:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13913:x1875544076562048:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658625.149616:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13913:x1875544076562048:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 287us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.149624:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:1.0:1788658625.161072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.161225:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562176 00000100:00100000:3.0:1788658625.161236:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562176 00000100:00100000:3.0:1788658625.161305:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:3.0:1788658625.161316:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13913:x1875544076562176:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658625.161593:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13913:x1875544076562176:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 278us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.161610:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:3.0:1788658625.179707:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658625.180217:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562304 00000100:00100000:2.0:1788658625.180228:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562304 00000100:00100000:2.0:1788658625.180310:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658625.180318:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875544076562304:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658625.180348:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9d29d269-69a5-47bf-9218-df6c9b443069@192.168.202.3@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788658625.180389:0:14418:0:(genops.c:1385:class_connect()) connect: client 9d29d269-69a5-47bf-9218-df6c9b443069, cookie 0xf657f176650ebeaa 00000004:00100000:2.0:1788658625.180417:0:14418:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788658625.180546:0:14418:0:(import.c:65:import_set_state_nolock()) ffff9e56db086000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658625.180629:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d29d269-69a5-47bf-9218-df6c9b443069+6:2350:x1875544076562304:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 310us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.180636:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000040:00080000:2.0:1788658625.181639:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658625.193711:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658625.193769:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.193866:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562560 00000100:00100000:3.0:1788658625.193877:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562560 00000100:00100000:3.0:1788658625.193955:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1788658625.193977:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+6:13903:x1875544076562560:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658625.194008:0:15832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788658625.194087:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+6:13903:x1875544076562560:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 112us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.194095:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00080000:0.0:1788658625.194445:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658625.194541:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562432 00000100:00100000:0.0:1788658625.194547:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562432 00000100:00100000:0.0:1788658625.194586:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1788658625.194595:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d29d269-69a5-47bf-9218-df6c9b443069+6:0:x1875544076562432:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788658625.194609:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788658625.194653:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d29d269-69a5-47bf-9218-df6c9b443069+6:0:x1875544076562432:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 59us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.194660:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:3.0:1788658625.203083:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658625.203265:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562688 00000100:00100000:1.0:1788658625.203275:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562688 00000100:00100000:1.0:1788658625.203335:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658625.203345:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d29d269-69a5-47bf-9218-df6c9b443069+6:13903:x1875544076562688:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788658625.203436:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d29d269-69a5-47bf-9218-df6c9b443069+6:13903:x1875544076562688:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.203461:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1788658625.207034:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.207082:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.207118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658625.207272:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562816 00000100:00100000:2.0:1788658625.207283:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562816 00000100:00100000:2.0:1788658625.207325:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076562944 00000100:00100000:2.0:1788658625.207329:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076562944 00000100:00100000:2.0:1788658625.207348:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658625.207358:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875544076562816:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658625.207390:0:15100:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9d29d269-69a5-47bf-9218-df6c9b443069@192.168.202.3@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788658625.207426:0:15100:0:(genops.c:1385:class_connect()) connect: client 9d29d269-69a5-47bf-9218-df6c9b443069, cookie 0xf657f176650ebeb1 00002000:00100000:2.0:1788658625.207439:0:15100:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9d29d269-69a5-47bf-9218-df6c9b443069/ffff9e56db083000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658625.207451:0:15100:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658625.207740:0:15100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788658625.207853:0:15100:0:(import.c:65:import_set_state_nolock()) ffff9e56db087800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658625.207924:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d29d269-69a5-47bf-9218-df6c9b443069+6:2350:x1875544076562816:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 564us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.207932:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658625.207951:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1788658625.208075:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563072 00000100:00100000:0.0:1788658625.208080:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563072 00000100:00100000:0.0:1788658625.208114:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:0.0:1788658625.208122:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d29d269-69a5-47bf-9218-df6c9b443069+6:13903:x1875544076563072:12345-192.168.202.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788658625.208202:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788658625.208262:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d29d269-69a5-47bf-9218-df6c9b443069+6:13903:x1875544076563072:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 141us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.208269:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:2.0:1788658625.208391:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875544076562944:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658625.208414:0:15100:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9d29d269-69a5-47bf-9218-df6c9b443069@192.168.202.3@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788658625.208435:0:15100:0:(genops.c:1385:class_connect()) connect: client 9d29d269-69a5-47bf-9218-df6c9b443069, cookie 0xf657f176650ebeb8 00002000:00100000:2.0:1788658625.208443:0:15100:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9d29d269-69a5-47bf-9218-df6c9b443069/ffff9e56db087000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658625.208458:0:15100:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658625.208626:0:15100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788658625.208644:0:15100:0:(import.c:65:import_set_state_nolock()) ffff9e56db083800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658625.208706:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d29d269-69a5-47bf-9218-df6c9b443069+6:2350:x1875544076562944:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 317us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.208713:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1788658625.209170:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.209316:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.209355:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.209427:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658625.209448:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563584 00000100:00100000:3.0:1788658625.209454:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563584 00000100:00100000:3.0:1788658625.209515:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563456 00000100:00100000:3.0:1788658625.209519:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563456 00000100:00100000:3.0:1788658625.209538:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658625.209545:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076563584:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658625.209581:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076563584:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.209599:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658625.209613:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1788658625.209619:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076563456:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658625.209642:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076563456:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 24us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.209648:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1788658625.209754:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563200 00000100:00100000:3.0:1788658625.209759:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563200 00000100:00100000:3.0:1788658625.212554:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:3.0:1788658625.212577:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2351:x1875544076563200:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658625.212691:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2351:x1875544076563200:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 123us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.212700:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:1.0:1788658625.217534:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563328 00000100:00100000:1.0:1788658625.217554:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563328 00000100:00100000:1.0:1788658625.217693:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658625.217705:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:2351:x1875544076563328:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658625.217794:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:2351:x1875544076563328:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 92us (8624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.217801:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1788658625.360111:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658625.361822:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563712 00000100:00100000:1.0:1788658625.361844:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563712 00000100:00100000:1.0:1788658625.361954:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658625.361967:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d29d269-69a5-47bf-9218-df6c9b443069+6:13934:x1875544076563712:12345-192.168.202.3@tcp:101:mkdir.0 00010000:00010000:1.0:1788658625.361991:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658625.362017:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679c00/0xf657f176650ebebf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b1ed expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.362122:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.362137:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.362152:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658625.362200:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658625.362205:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658625.362224:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.362271:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679c00/0xf657f176650ebebf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 8 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.362294:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.362303:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:1.0:1788658625.362306:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658625.362311:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35600, rc 0) 00000100:00100000:1.0:1788658625.362403:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d29d269-69a5-47bf-9218-df6c9b443069+7:13934:x1875544076563712:12345-192.168.202.3@tcp:101:mkdir.0 Request processed in 438us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.362411:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00010000:00010000:3.0:1788658625.756841:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658626.780802:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658627.818949:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658627.936335:0:16381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788658628.081589:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9d29d269-69a5-47bf-9218-df6c9b443069 00000001:00100000:1.0:1788658628.081620:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59fc9cf2-29f7-4afb-a889-1aea3676cd57 00010000:00010000:3.0:1788658628.828872:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658629.020905:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658629.020928:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103815936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658629.021000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658629.021698:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103815936 00000100:00100000:1.0:1788658629.021708:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103815936 00000100:00080000:3.0:1788658629.022857:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658629.022914:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658629.022929:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103815936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658629.022981:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658629.023067:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103815936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658629.023075:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658629.028283:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788658629.028329:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103815936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658629.028844:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103816192:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.028921:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658629.028956:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788658629.028972:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103816064:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029002:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658629.029033:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103816576:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658629.029085:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103816448:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658629.029125:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658629.029130:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103816320:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658629.029178:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103816192 00000100:00100000:3.0:1788658629.029184:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103816192 00000100:00100000:3.0:1788658629.029235:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658629.029243:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103816192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029292:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103816192:12345-0@lo:400:kworker.0 Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658629.029298:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658629.029321:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103816576 00000100:00100000:3.0:1788658629.029325:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103816576 00000100:00100000:3.0:1788658629.029350:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103816448 00000100:00100000:3.0:1788658629.029352:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103816448 00000100:00100000:3.0:1788658629.029365:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103816320 00000100:00100000:3.0:1788658629.029366:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103816320 00000100:00100000:3.0:1788658629.029374:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658629.029377:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103816576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029398:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103816576:12345-0@lo:400:kworker.0 Request processed in 21us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658629.029408:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658629.029416:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658629.029419:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103816448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029439:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103816448:12345-0@lo:400:kworker.0 Request processed in 19us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658629.029443:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658629.029448:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658629.029452:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103816320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029465:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103816320:12345-0@lo:400:kworker.0 Request processed in 14us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658629.029468:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788658629.029486:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658629.029489:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658629.029502:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103816320:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029508:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103816448:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029522:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103816576:0@lo:400:kworker.0 00000100:00100000:3.0:1788658629.029527:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103816192:0@lo:400:kworker.0 00000100:00100000:2.0:1788658629.030132:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103816064 00000100:00100000:2.0:1788658629.030140:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103816064 00000100:00100000:2.0:1788658629.030169:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788658629.030177:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+19:3307:x1875544103816064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658629.030230:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+19:3307:x1875544103816064:12345-0@lo:400:kworker.0 Request processed in 53us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658629.030237:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788658629.030257:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103816064:0@lo:400:kworker.0 00000001:00100000:2.0:1788658629.098846:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9d29d269-69a5-47bf-9218-df6c9b443069 00000100:00100000:2.0:1788658629.532862:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658629.532881:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103816704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658629.532961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658629.533125:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103816704 00000100:00100000:0.0:1788658629.533134:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103816704 00000100:00100000:0.0:1788658629.533182:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658629.533190:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103816704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658629.533225:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658629.533282:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103816704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658629.533289:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658629.533453:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103816704:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788658629.604684:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9d29d269-69a5-47bf-9218-df6c9b443069 00010000:00010000:3.0:1788658629.853433:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658630.322063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658630.322100:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658630.322130:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563968 00000100:00100000:1.0:1788658630.322132:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658630.322143:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563968 00000100:00100000:1.0:1788658630.322159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658630.322193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658630.322210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658630.322211:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1788658630.322223:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2351:x1875544076563968:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658630.322244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658630.322268:0:15581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564224 00000100:00100000:1.0:1788658630.322271:0:15581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564224 00000100:00100000:1.0:1788658630.322294:0:15581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564480 00000100:00100000:1.0:1788658630.322296:0:15581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564480 00000100:00100000:3.0:1788658630.322316:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2351:x1875544076563968:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.322324:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1788658630.322341:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564352 00000100:00100000:3.0:1788658630.322344:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564352 00000100:00100000:3.0:1788658630.322365:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1788658630.322377:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+6:2351:x1875544076564352:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658630.322404:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+6:2351:x1875544076564352:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.322410:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00080000:3.0:1788658630.322426:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658630.322430:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658630.322432:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658630.322578:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564096 00000100:00100000:0.0:1788658630.322583:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564096 00000100:00100000:0.0:1788658630.322614:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564608 00000100:00100000:0.0:1788658630.322617:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564608 00000100:00100000:0.0:1788658630.322631:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658630.322638:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076564224:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658630.322693:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076564224:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 55us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658630.322700:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658630.322712:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658630.322718:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076564096:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658630.322741:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076564096:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 23us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658630.322755:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658630.322784:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1788658630.322791:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076564608:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658630.322816:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076564608:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658630.322821:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1788658630.322917:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076563840 00000100:00100000:0.0:1788658630.322921:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076563840 00000100:00100000:0.0:1788658630.322945:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:0.0:1788658630.322951:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2351:x1875544076563840:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658630.322979:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2351:x1875544076563840:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.322984:0:15581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:0.0:1788658630.322985:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:1.0:1788658630.322992:0:15581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076564480:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658630.323017:0:15581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076564480:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.323023:0:15581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00080000:3.0:1788658630.323206:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658630.323210:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788658630.692384:0:16532:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4296c380 20000000:00000080:2.0:1788658630.692404:0:16532:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e55c286e400 uarg=0000000000000000 20000000:01000000:2.0:1788658630.692442:0:16532:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788658630.692449:0:16532:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788658630.692454:0:16532:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788658630.693520:0:16533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788658630.693857:0:16532:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788658630.699460:0:16532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788658630.701880:0:16532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.701910:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebbbd expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.701918:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebc0a expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.701926:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebd3e expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.701937:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.701963:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.701972:0:16532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.702019:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.702033:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 12 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.702049:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103816832:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658630.702932:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.702947:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 12 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.702958:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103816960:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658630.703338:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ebd3e expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.703347:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ebd3e expref: 18 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.703356:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103817088:0@lo:104: 00000100:00100000:3.0:1788658630.703393:0:16532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658630.703432:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ebc0a expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.703442:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ebc0a expref: 18 pid: 14412 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.703450:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103817216:0@lo:104: 00000100:00100000:3.0:1788658630.703470:0:16532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658630.703494:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ebbbd expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.703502:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ebbbd expref: 18 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.703510:0:16532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103817344:0@lo:104: 00000100:00100000:3.0:1788658630.703534:0:16532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.703544:0:16532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658630.703723:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788658630.703741:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817088 00000100:00100000:2.0:1788658630.703749:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817088 00000100:00100000:2.0:1788658630.703792:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817216 00000100:00100000:2.0:1788658630.703795:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817216 00000100:00100000:2.0:1788658630.703805:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817344 00000100:00100000:2.0:1788658630.703807:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817344 00000100:00100000:2.0:1788658630.703820:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658630.703829:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+5:16532:x1875544103817088:12345-0@lo:104: 00010000:00010000:2.0:1788658630.703852:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.703905:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658630.703911:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+5:16532:x1875544103817088:12345-0@lo:104: Request processed in 84us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658630.703918:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658630.703933:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658630.703939:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+4:16532:x1875544103817216:12345-0@lo:104: 00010000:00010000:2.0:1788658630.703946:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.703976:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788658630.703980:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+4:16532:x1875544103817216:12345-0@lo:104: Request processed in 42us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658630.703986:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658630.703997:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658630.704003:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c324f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+3:16532:x1875544103817344:12345-0@lo:104: 00010000:00010000:2.0:1788658630.704011:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.704054:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788658630.704059:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c324f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7221c739-be00-4743-a572-f61de58b82dc+3:16532:x1875544103817344:12345-0@lo:104: Request processed in 56us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658630.704065:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658630.708221:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103817088:0@lo:104: 00000100:00100000:2.0:1788658630.708239:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103817216:0@lo:104: 00000100:00100000:2.0:1788658630.708247:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103817344:0@lo:104: 00010000:00010000:2.0:1788658630.709728:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788658630.709743:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709755:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29df200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658630.709760:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709772:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658630.709780:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658630.709786:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658630.709837:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709853:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658630.709873:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709901:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c29df200/0xf657f176650ebd3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebd45 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709916:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658630.709920:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709925:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79400 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658630.709929:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709936:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658630.709941:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658630.709946:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658630.709965:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709971:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658630.709977:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709983:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac79400/0xf657f176650ebc0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebc11 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.709992:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658630.710001:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.710007:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658630.710010:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.710016:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658630.710022:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658630.710027:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658630.710040:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.710046:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658630.710064:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.710070:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac78a00/0xf657f176650ebbbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ebbc4 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.710086:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.710088:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.710090:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658630.710108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103817728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658630.710178:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658630.713893:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658630.713958:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103817472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658630.714053:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.714132:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658630.714139:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103817600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658630.714178:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.714216:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817728 00000100:00100000:3.0:1788658630.714223:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817728 00010000:00010000:3.0:1788658630.714258:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebbbd expref: 19 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.714281:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817472 00000100:00100000:3.0:1788658630.714285:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817472 00010000:00010000:3.0:1788658630.714314:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebd3e expref: 20 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.714326:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817600 00000100:00100000:3.0:1788658630.714329:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817600 00010000:00010000:3.0:1788658630.714340:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebc0a expref: 21 pid: 14412 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658630.714353:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658630.714362:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7221c739-be00-4743-a572-f61de58b82dc+21:3306:x1875544103817728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658630.714375:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658630.714380:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebbbd expref: 21 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714391:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ebbbd expref: 21 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714407:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891b800/0xf657f176650ebbc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ebbbd expref: 21 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714423:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658630.714462:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7221c739-be00-4743-a572-f61de58b82dc+20:3306:x1875544103817728:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.714469:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658630.714486:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658630.714492:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7221c739-be00-4743-a572-f61de58b82dc+19:3304:x1875544103817472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658630.714499:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658630.714504:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebd3e expref: 19 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714523:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ebd3e expref: 19 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714533:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891b200/0xf657f176650ebd45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ebd3e expref: 19 pid: 14414 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714542:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658630.714570:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7221c739-be00-4743-a572-f61de58b82dc+18:3304:x1875544103817472:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.714577:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658630.714589:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658630.714609:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7221c739-be00-4743-a572-f61de58b82dc+17:3304:x1875544103817600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658630.714628:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658630.714632:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ebc0a expref: 17 pid: 14412 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714640:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ebc0a expref: 17 pid: 14412 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714649:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891b600/0xf657f176650ebc11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ebc0a expref: 17 pid: 14412 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.714657:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658630.714723:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7221c739-be00-4743-a572-f61de58b82dc+16:3304:x1875544103817600:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.714729:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658630.714787:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103817600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658630.714797:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103817472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658630.714863:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103817728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658630.717957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1788658630.717994:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658630.718021:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564736 00000100:00100000:0.0:1788658630.718030:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564736 00010000:00010000:0.0:1788658630.718068:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 13 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658630.718106:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658630.718115:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2352:x1875544076564736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658630.718128:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658630.718134:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 13 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.718166:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 13 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.718200:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658630.718257:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2352:x1875544076564736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658630.718265:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00010000:00010000:2.0:1788658630.718866:0:16532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891ba00/0xf657f176650ebea3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1c3 expref: 12 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658630.718893:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103816832:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658630.726037:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658630.726051:0:16532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1875544103816960:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658630.726096:0:16532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658630.726220:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564864 00000100:00100000:1.0:1788658630.726227:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564864 00010000:00010000:1.0:1788658630.726264:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 12 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658630.726302:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658630.726311:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+12:2352:x1875544076564864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658630.726326:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658630.726332:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 12 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726344:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 12 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726362:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678600/0xf657f176650ebe6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b161 expref: 12 pid: 14413 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726393:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726400:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726412:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726417:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726422:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726426:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726430:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29de400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658630.726433:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726438:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726451:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.726459:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658630.726471:0:16532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.726478:0:16532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.726483:0:16532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29de400/0xf657f176650ebecd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658630.726557:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+11:2352:x1875544076564864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 247us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.726570:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00010000:00010000:2.0:1788658630.877140:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658631.905853:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788658632.031007:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658632.031017:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56eec4f000 from 10 10000000:01000000:1.0:1788658632.031023:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658632.031090:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.031104:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.031114:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658632.031140:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103817856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658632.031217:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658632.031270:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658632.036793:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817856 00000100:00100000:3.0:1788658632.036813:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817856 00000100:00100000:3.0:1788658632.036962:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658632.036973:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+16:14416:x1875544103817856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658632.036993:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658632.037016:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c29dec00/0xf657f176650ebedb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebed4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658632.037046:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c29dec00/0xf657f176650ebedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebed4 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658632.037208:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c29dec00/0xf657f176650ebedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebed4 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658632.037218:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dec00, rc 0) 00000100:00100000:3.0:1788658632.037301:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+17:14416:x1875544103817856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 330us (6083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658632.037309:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658632.037376:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103817856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658632.037395:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658632.037405:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658632.037473:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103817984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658632.037513:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658632.038181:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658632.038205:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103817984 00000100:00100000:3.0:1788658632.038210:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103817984 00000100:00100000:3.0:1788658632.038243:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788658632.038250:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+17:14416:x1875544103817984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658632.038507:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+17:14416:x1875544103817984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658632.038515:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788658632.038721:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103817984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.038846:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.038894:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658632.038917:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658632.038931:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103818112 00000100:00100000:2.0:1788658632.038936:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103818112 00000100:00100000:2.0:1788658632.038960:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788658632.038968:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103818112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658632.046924:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+17:14416:x1875544103818112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7947us (8020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.046940:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788658632.047763:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788658632.050396:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788658632.050884:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788658632.050921:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658632.050932:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.050950:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658632.050960:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658632.050963:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56e5c8d800 from 10 10000000:01000000:2.0:1788658632.050966:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658632.051007:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.051015:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.051027:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658632.051067:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.051134:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658632.051169:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658632.051188:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103818240 00000100:00100000:2.0:1788658632.051195:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103818240 00000100:00100000:2.0:1788658632.051240:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788658632.051248:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+17:14416:x1875544103818240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658632.051262:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658632.051275:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891a600/0xf657f176650ebee9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebee2 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.051298:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891a600/0xf657f176650ebee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebee2 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.051320:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891a600/0xf657f176650ebee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebee2 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.051329:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a600, rc 0) 00000100:00100000:2.0:1788658632.051364:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103818240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.051372:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788658632.051420:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658632.051434:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.051443:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658632.051489:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.051512:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658632.051541:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658632.051552:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103818368 00000100:00100000:2.0:1788658632.051555:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103818368 00000100:00100000:2.0:1788658632.051576:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788658632.051582:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103818368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.051853:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103818368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.051861:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788658632.051890:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.051925:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.051959:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658632.051977:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d67de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658632.051988:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103818496 00000100:00100000:2.0:1788658632.051992:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103818496 00000100:00100000:2.0:1788658632.052012:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788658632.052019:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103818496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.052156:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103818496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.052163:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788658632.052214:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658632.078180:0:16595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788658632.078633:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788658632.078655:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658632.078690:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658632.078703:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658632.078715:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658632.078717:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56d00a1000 from 10 10000000:01000000:3.0:1788658632.078721:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658632.078773:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658632.078782:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658632.078792:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658632.078828:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658632.078899:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658632.078944:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658632.079023:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103818624 00000100:00100000:2.0:1788658632.079030:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103818624 00000100:00100000:2.0:1788658632.080309:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788658632.080326:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+18:14416:x1875544103818624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658632.080342:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658632.080360:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891a400/0xf657f176650ebef7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ebef0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.080389:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891a400/0xf657f176650ebef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ebef0 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.080402:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891a400/0xf657f176650ebef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ebef0 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.080411:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891a400, rc 0) 00000100:00100000:2.0:1788658632.080488:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103818624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.080495:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788658632.080631:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658632.080649:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.080659:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658632.080754:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.080788:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658632.080814:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56df107900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658632.080827:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103818752 00000100:00100000:2.0:1788658632.080833:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103818752 00000100:00100000:2.0:1788658632.080859:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788658632.080866:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103818752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.082328:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103818752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1455us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.082339:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788658632.082813:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658632.082867:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658632.082921:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658632.082955:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56efab3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658632.083849:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103818880 00000100:00100000:2.0:1788658632.083858:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103818880 00000100:00100000:2.0:1788658632.083904:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788658632.083913:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103818880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658632.084177:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:14416:x1875544103818880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.084194:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788658632.084245:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7221c739-be00-4743-a572-f61de58b82dc:14416:1875544103818880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788658632.088823:0:16598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788658632.090661:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788658632.090720:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658632.090735:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.090785:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658632.556577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658632.556641:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076564992 00000100:00100000:2.0:1788658632.556652:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076564992 00000100:00100000:2.0:1788658632.556781:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:2.0:1788658632.556792:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+11:13789:x1875544076564992:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658632.556811:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658632.556830:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56c891b800/0xf657f176650ebefe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b1f4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.556858:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56c891b800/0xf657f176650ebefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1f4 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.556871:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56c891b800/0xf657f176650ebefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1f4 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658632.556880:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b800, rc 0) 00000100:00100000:2.0:1788658632.556935:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13789:x1875544076564992:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 143us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.556969:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:2.0:1788658632.559990:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658632.560139:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076565120 00000100:00100000:0.0:1788658632.560149:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076565120 00000100:00100000:0.0:1788658632.560202:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:0.0:1788658632.560211:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13789:x1875544076565120:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658632.560491:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13789:x1875544076565120:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 279us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.560500:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:1.0:1788658632.568512:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658632.568599:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076565248 00000100:00100000:0.0:1788658632.568610:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076565248 00000100:00100000:0.0:1788658632.568691:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:0.0:1788658632.568712:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13789:x1875544076565248:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658632.569010:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13789:x1875544076565248:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 308us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.569019:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:1.0:1788658632.574583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658632.574631:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076565376 00000100:00100000:1.0:1788658632.574642:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076565376 00000100:00100000:1.0:1788658632.574729:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:1.0:1788658632.574740:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+12:13789:x1875544076565376:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658632.574771:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658632.574791:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed34c00/0xf657f176650ebf05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b1fb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.574823:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed34c00/0xf657f176650ebf05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1fb expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.574835:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed34c00/0xf657f176650ebf05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1fb expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.574845:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34c00, rc 0) 00000100:00100000:1.0:1788658632.574900:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13789:x1875544076565376:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 163us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.574907:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:2.0:1788658632.585348:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658632.587146:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076565504 00000100:00100000:0.0:1788658632.587160:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076565504 00000100:00100000:0.0:1788658632.587429:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:0.0:1788658632.587443:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13789:x1875544076565504:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658632.587916:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13789:x1875544076565504:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 471us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.587927:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:2.0:1788658632.591894:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658632.593787:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076565632 00000100:00100000:0.0:1788658632.593802:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076565632 00000100:00100000:0.0:1788658632.593858:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:0.0:1788658632.593867:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13789:x1875544076565632:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658632.594095:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:13789:x1875544076565632:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 228us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.594103:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 118 00010000:00010000:0.0:1788658632.927119:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658633.950055:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658634.020579:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.020753:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076565760 00000100:00100000:3.0:1788658634.020767:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076565760 00000100:00100000:3.0:1788658634.020877:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1788658634.020890:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:14443:x1875544076565760:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658634.020918:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658634.020951:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b202 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.021039:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.021057:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.021074:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.021091:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.021121:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.021129:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658634.021296:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658634.022322:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29de400/0xf657f176650ebf21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022343:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29de400/0xf657f176650ebf21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022353:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29de400/0xf657f176650ebf21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658634.022392:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788658634.022397:0:14419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658634.022448:0:14419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29de400/0xf657f176650ebf21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022461:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022469:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022477:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022483:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658634.022489:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022506:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022521:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:3.0:1788658634.022524:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658634.022530:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022537:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022554:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022560:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022567:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022572:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658634.022575:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022582:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022589:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e56c55f1c00) 00010000:00010000:3.0:1788658634.022592:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658634.022595:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022621:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022728:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b202 expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022745:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29de400/0xf657f176650ebf21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b202 expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.022753:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56c55f1e00) 00010000:00010000:3.0:1788658634.022756:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658634.022758:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29de400, rc 0) 00000100:00100000:3.0:1788658634.022855:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:14443:x1875544076565760:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1967us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.022865:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1788658634.032471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.032706:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076566016 00000100:00100000:0.0:1788658634.032723:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076566016 00000100:00100000:0.0:1788658634.032807:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:0.0:1788658634.032822:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:14443:x1875544076566016:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658634.032851:0:15833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658634.032885:0:15833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b209 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.033003:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.033074:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.033114:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.040194:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.040220:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.040233:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.044633:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ebf3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.044656:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ebf3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.045095:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ebf3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658634.045110:0:15833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788658634.046065:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046077:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046084:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046090:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658634.046103:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046111:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046125:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56c55f1e00) 00010000:00010000:0.0:1788658634.046127:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658634.046131:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046138:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebf2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046150:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046157:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046162:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046167:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658634.046169:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046175:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046181:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e56c3c69200) 00010000:00010000:0.0:1788658634.046183:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658634.046190:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.046196:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.047282:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b209 expref: 10 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.047306:0:15833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ebf3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b209 expref: 9 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.047315:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69000) 00010000:00010000:0.0:1788658634.047328:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658634.047331:0:15833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9200, rc 0) 00000100:00100000:0.0:1788658634.047415:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14443:x1875544076566016:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 14595us (14960us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788658634.047424:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:0.0:1788658634.054268:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.055395:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076566144 00000100:00100000:3.0:1788658634.055415:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076566144 00000100:00100000:3.0:1788658634.055506:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:3.0:1788658634.055521:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14443:x1875544076566144:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788658634.055908:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14443:x1875544076566144:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 Request processed in 389us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.055917:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:1.0:1788658634.103812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.103988:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076566272 00000100:00100000:3.0:1788658634.104001:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076566272 00000100:00100000:3.0:1788658634.104141:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1788658634.104173:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14449:x1875544076566272:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658634.104201:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658634.104229:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b210 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104325:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104345:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104359:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104376:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104383:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104391:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104644:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104712:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104721:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104738:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658634.104744:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104754:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104771:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:3.0:1788658634.104774:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658634.104780:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104787:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104806:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104813:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104820:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104826:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29dfc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658634.104830:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104836:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104854:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e56c55f1c00) 00010000:00010000:3.0:1788658634.104857:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658634.104860:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104867:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104910:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b210 expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104922:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:3.0:1788658634.104924:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658634.104928:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b210 expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.104937:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dfe00, rc 0) 00000100:00100000:3.0:1788658634.105028:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14449:x1875544076566272:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 858us (1231us total) trans 0 rc 301/301 00000100:00100000:3.0:1788658634.105036:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:2.0:1788658634.112052:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.113847:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076566400 00000100:00100000:0.0:1788658634.113863:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076566400 00000100:00100000:0.0:1788658634.114101:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658634.114116:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14449:x1875544076566400:12345-192.168.202.3@tcp:700:lfs.0 00000100:00100000:0.0:1788658634.114223:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14449:x1875544076566400:12345-192.168.202.3@tcp:700:lfs.0 Request processed in 110us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658634.114232:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1788658634.119933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.120172:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076566656 00000100:00100000:0.0:1788658634.120182:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076566656 00000100:00100000:0.0:1788658634.120264:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:0.0:1788658634.120274:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14449:x1875544076566656:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:0.0:1788658634.120341:0:15833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658634.120367:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c1679000/0xf657f176650ebe8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b18b expref: 9 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.120387:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:0.0:1788658634.120393:0:15833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658634.120628:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.120644:0:15833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 5 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.120653:0:15833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.122998:0:15833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 5 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.123023:0:15833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 5 pid: 14418 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658634.123039:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103819008:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658634.123152:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8ddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658634.129870:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.130035:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076566784 00000100:00100000:3.0:1788658634.130059:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076566784 00000100:00100000:0.0:1788658634.130121:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103819008:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658634.130146:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 6 pid: 14418 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.130156:0:15833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658634.130242:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1788658634.130255:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d29d269-69a5-47bf-9218-df6c9b443069+6:2352:x1875544076566784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658634.130289:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658634.130297:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 6 pid: 14418 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.130313:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 6 pid: 14418 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.130341:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ebec6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1ed expref: 6 pid: 14418 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.130363:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:3.0:1788658634.130378:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.130389:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.130398:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.130433:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658634.130464:0:15833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.130476:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658634.130507:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d29d269-69a5-47bf-9218-df6c9b443069+5:2352:x1875544076566784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 250us (648us total) trans 0 rc 0/0 00010000:00010000:0.0:1788658634.130509:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658634.130527:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00010000:00010000:0.0:1788658634.130537:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.130551:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788658634.130604:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788658634.132144:0:15833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788658634.132163:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.132174:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.132182:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.132187:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658634.132193:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.132210:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.132226:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c59900) 00010000:00010000:1.0:1788658634.132230:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658634.132235:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.132242:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebf60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658634.132266:0:15833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aca630ee reply state 000000003ed88987 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658634.132276:0:15833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788658634.132409:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:14449:x1875544076566656:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 12131us (12491us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788658634.132418:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00010000:00010000:2.0:1788658634.141142:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.141166:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.141174:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.141181:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658634.141186:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.141194:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.141221:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e56c3c69200) 00010000:00010000:2.0:1788658634.141224:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658634.141231:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.141237:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebf67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658634.141959:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103819136:0@lo:400:kworker.0 00000100:00100000:3.0:1788658634.142046:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658634.142191:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103819264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658634.142355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658634.142467:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658634.142474:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103819392:0@lo:400:kworker.0 00000100:00100000:2.0:1788658634.142505:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658634.142544:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103819392 00000100:00100000:2.0:1788658634.142552:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103819392 00000100:00100000:3.0:1788658634.142785:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658634.142796:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103819520:0@lo:400:kworker.0 00000100:00100000:3.0:1788658634.142853:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658634.142905:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103819136 00000100:00100000:2.0:1788658634.142918:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103819520 00000100:00100000:2.0:1788658634.142924:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103819520 00000100:00100000:2.0:1788658634.142966:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658634.143007:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103819136 00000100:00100000:3.0:1788658634.143072:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788658634.143078:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103819264 00000100:00100000:3.0:1788658634.143085:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:3307:x1875544103819136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658634.143086:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103819264 00000100:00100000:1.0:1788658634.143131:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658634.143143:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875544103819264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658634.143157:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7221c739-be00-4743-a572-f61de58b82dc+19:3307:x1875544103819136:12345-0@lo:400:kworker.0 Request processed in 73us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.143167:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00002000:00000024:1.0:1788658634.143187:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788658634.143249:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658634.143259:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875544103819264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.143267:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103819520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658634.143276:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658634.143402:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103819520:12345-0@lo:400:kworker.0 Request processed in 60us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.143410:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658634.143506:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103819392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658634.143564:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103819392:12345-0@lo:400:kworker.0 Request processed in 66us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.143574:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788658634.143706:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658634.143712:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658634.143832:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103819520:0@lo:400:kworker.0 00000100:00100000:3.0:1788658634.143843:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7221c739-be00-4743-a572-f61de58b82dc:3307:1875544103819136:0@lo:400:kworker.0 00000100:00100000:2.0:1788658634.143954:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103819392:0@lo:400:kworker.0 00000100:00100000:2.0:1788658634.144111:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103819264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658634.144943:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658634.144958:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103819648:0@lo:400:kworker.0 00000100:00100000:0.0:1788658634.145012:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658634.145053:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103819904:0@lo:400:kworker.0 00000100:00100000:0.0:1788658634.145077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658634.145098:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658634.145103:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103819776:0@lo:400:kworker.0 00000100:00100000:0.0:1788658634.145128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658634.145168:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103819648 00000100:00100000:0.0:1788658634.145175:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103819648 00000100:00100000:0.0:1788658634.145215:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103819904 00000100:00100000:0.0:1788658634.145218:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103819904 00000100:00100000:0.0:1788658634.145250:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103819776 00000100:00100000:0.0:1788658634.145254:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103819776 00000100:00100000:2.0:1788658634.145279:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788658634.145298:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103819648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658634.145304:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658634.145338:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103819904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658634.145397:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103819904:12345-0@lo:400:kworker.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658634.145404:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658634.145420:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658634.145426:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103819776:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788658634.145631:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658634.145794:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103819648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658634.145862:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103819904:0@lo:400:kworker.0 00000100:00100000:0.0:1788658634.146107:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103819776:12345-0@lo:400:kworker.0 Request processed in 679us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658634.146116:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658634.146124:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103819648:12345-0@lo:400:kworker.0 Request processed in 829us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.146137:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658634.146154:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103819776:0@lo:400:kworker.0 00000100:00100000:0.0:1788658634.279343:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.279628:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076566912 00000100:00100000:3.0:1788658634.279640:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076566912 00000100:00100000:3.0:1788658634.279846:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:3.0:1788658634.279858:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:14457:x1875544076566912:12345-192.168.202.3@tcp:101:lctl.0 00010000:00010000:3.0:1788658634.279903:0:15832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658634.279928:0:15832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b217 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.280021:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.280039:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.280054:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658634.280098:0:15832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788658634.280102:0:15832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658634.280155:0:15832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.280180:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b217 expref: 11 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.280199:0:15832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b217 expref: 10 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.280208:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:3.0:1788658634.280211:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658634.280215:0:15832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dfc00, rc 0) 00000100:00100000:3.0:1788658634.280287:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:14457:x1875544076566912:12345-192.168.202.3@tcp:101:lctl.0 Request processed in 431us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.280295:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1788658634.308995:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.309208:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076567040 00000100:00100000:3.0:1788658634.309218:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076567040 00000100:00100000:3.0:1788658634.309300:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:3.0:1788658634.309310:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+5:14458:x1875544076567040:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658634.309331:0:15833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658634.309354:0:15833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b21e expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.309427:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.309442:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.309457:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658634.309494:0:15833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788658634.309498:0:15833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658634.309536:0:15833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.309564:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebf7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b21e expref: 7 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.309596:0:15833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b21e expref: 6 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.309605:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:3.0:1788658634.309608:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658634.309612:0:15833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dfa00, rc 0) 00000100:00100000:3.0:1788658634.310128:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+6:14458:x1875544076567040:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 816us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.310144:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1788658634.314998:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.315122:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076567168 00000100:00100000:2.0:1788658634.315133:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076567168 00000100:00100000:2.0:1788658634.315205:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:2.0:1788658634.315216:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d29d269-69a5-47bf-9218-df6c9b443069+6:14458:x1875544076567168:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658634.315238:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658634.315257:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebf8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b225 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.315322:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.315337:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.315348:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.315499:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.316175:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.316186:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.316432:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ebf9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.316442:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ebf9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.316450:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ebf9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658634.316619:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658634.316624:0:14419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658634.316652:0:14419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ebf9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317008:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317017:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317024:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317031:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658634.317036:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317044:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317059:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:2.0:1788658634.317062:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658634.317067:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317074:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebf91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317089:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317109:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317114:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317119:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658634.317121:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317127:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317134:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e56d579c100) 00010000:00010000:2.0:1788658634.317137:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658634.317139:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317145:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebf98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317188:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebf8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b225 expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317202:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ebf9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b225 expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.317209:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658634.317211:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658634.317220:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b200, rc 0) 00000100:00100000:2.0:1788658634.317373:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d29d269-69a5-47bf-9218-df6c9b443069+7:14458:x1875544076567168:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2157us (2503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.317382:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1788658634.322204:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.322300:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076567424 00000100:00100000:3.0:1788658634.322311:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076567424 00000100:00100000:3.0:1788658634.322469:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:3.0:1788658634.322482:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+7:14458:x1875544076567424:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658634.322505:0:15832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658634.322528:0:15832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebfa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b22c expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658634.322640:0:15832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788658634.322836:0:15832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebfa6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b22c expref: 9 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.322851:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:3.0:1788658634.322854:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658634.322861:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebfa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b22c expref: 9 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.322894:0:15832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c29dfe00, rc 0) 00000100:00100000:3.0:1788658634.322947:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+8:14458:x1875544076567424:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 468us (751us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788658634.322954:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:1.0:1788658634.327247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.327342:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076567680 00000100:00100000:2.0:1788658634.327420:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076567680 00000100:00100000:2.0:1788658634.327588:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1788658634.327601:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+8:14458:x1875544076567680:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1788658634.328029:0:15833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658634.328060:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ebf9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b225 expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.328081:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579c300) 00010000:00010000:2.0:1788658634.328092:0:15833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658634.328117:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.328130:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.328141:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658634.328450:0:15833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec1450c0 reply state 00000000b9e572ba transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658634.328461:0:15833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788658634.328469:0:15833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788658634.329160:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+9:14458:x1875544076567680:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 1556us (1918us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788658634.329185:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00010000:00010000:2.0:1788658634.334054:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334073:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334081:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334086:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ba00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658634.334091:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334099:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334115:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579c100) 00010000:00010000:2.0:1788658634.334118:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788658634.334124:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334131:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ebfb4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658634.334331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.334405:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076567808 00000100:00100000:2.0:1788658634.334415:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076567808 00000100:00100000:2.0:1788658634.334459:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1788658634.334468:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d29d269-69a5-47bf-9218-df6c9b443069+8:14458:x1875544076567808:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658634.334489:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658634.334633:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebfbb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b233 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334824:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334836:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.334846:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658634.334995:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788658634.334999:0:14419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658634.335019:0:14419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.335046:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ebfbb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.335060:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 9 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.335068:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658634.335070:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658634.335073:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891aa00, rc 0) 00000100:00100000:2.0:1788658634.335124:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d29d269-69a5-47bf-9218-df6c9b443069+9:14458:x1875544076567808:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 656us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.335131:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:0.0:1788658634.340035:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.340245:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076567936 00000100:00100000:3.0:1788658634.340255:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076567936 00000100:00100000:3.0:1788658634.340318:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:3.0:1788658634.340328:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d29d269-69a5-47bf-9218-df6c9b443069+9:14458:x1875544076567936:12345-192.168.202.3@tcp:37:lfs.0 00000100:00100000:2.0:1788658634.346626:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d29d269-69a5-47bf-9218-df6c9b443069+9:14458:x1875544076567936:12345-192.168.202.3@tcp:37:lfs.0 Request processed in 6286us (6587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.346658:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658634.349656:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658634.349790:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076568192 00000100:00100000:1.0:1788658634.349801:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076568192 00000100:00100000:1.0:1788658634.349855:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:1.0:1788658634.349878:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d29d269-69a5-47bf-9218-df6c9b443069+9:14458:x1875544076568192:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658634.350134:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d29d269-69a5-47bf-9218-df6c9b443069+10:14458:x1875544076568192:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 269us (490us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788658634.350142:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:0.0:1788658634.393775:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.394169:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076568320 00000100:00100000:3.0:1788658634.394181:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076568320 00000100:00100000:0.0:1788658634.394437:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:0.0:1788658634.394450:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:14464:x1875544076568320:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658634.394473:0:15832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658634.394495:0:15832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ebfc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b23a expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394604:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394621:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394647:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394690:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394699:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394706:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394801:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebfde lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394810:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebfde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.394818:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebfde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658634.394846:0:15832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788658634.394850:0:15832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658634.395022:0:15832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebfde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395035:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395041:0:15832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395058:0:15832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395064:0:15832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658634.395068:0:15832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395076:0:15832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395088:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:0.0:1788658634.395092:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658634.395096:0:15832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395102:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ebfd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395116:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395122:0:15832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395128:0:15832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395133:0:15832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658634.395135:0:15832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395151:0:15832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395161:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e56c3c69400) 00010000:00010000:0.0:1788658634.395163:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658634.395166:0:15832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395172:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ebfd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395208:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ebfc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b23a expref: 12 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395221:0:15832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebfde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b23a expref: 11 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.395229:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:0.0:1788658634.395231:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788658634.395234:0:15832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9600, rc 0) 00000100:00100000:0.0:1788658634.395451:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+11:14464:x1875544076568320:12345-192.168.202.3@tcp:101:bash.0 Request processed in 1002us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658634.395460:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000040:00080000:2.0:1788658634.399072:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658634.399744:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.400012:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076568576 00000100:00100000:3.0:1788658634.400023:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076568576 00000100:00100000:3.0:1788658634.400083:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:3.0:1788658634.400095:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+11:14464:x1875544076568576:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1788658634.400118:0:15833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658634.400140:0:15833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebfe5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b241 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.400267:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.400283:0:15833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 9 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.400292:0:15833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.400326:0:15833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 9 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.400339:0:15833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 9 pid: 14419 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658634.400432:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eedb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820032:192.168.202.3@tcp:104: 00000100:00100000:3.0:1788658634.400631:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6fb4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658634.406315:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.406412:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076568704 00000100:00100000:2.0:1788658634.406422:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076568704 00010000:00010000:2.0:1788658634.406460:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 10 pid: 14419 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658634.406496:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658634.406521:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d29d269-69a5-47bf-9218-df6c9b443069+10:2351:x1875544076568704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658634.406536:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658634.406543:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 10 pid: 14419 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.406557:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 10 pid: 14419 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.406589:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658634.406595:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.406605:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.406613:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.406632:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658634.407037:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ebfc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b233 expref: 10 pid: 14419 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658634.407072:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eedb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820032:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658634.407094:0:15833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.407104:0:15833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.407110:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.407149:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.407161:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.407170:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408333:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408348:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408357:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658634.408369:0:15833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788658634.408399:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408413:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408420:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408426:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29df200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658634.408430:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408438:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408450:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:3.0:1788658634.408453:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658634.408458:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408463:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29df200/0xf657f176650ebfec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658634.408478:0:15833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ea1ce76 reply state 00000000969841ec transno 8589934598 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658634.408486:0:15833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788658634.408755:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfe00/0xf657f176650ebfe5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 14 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408772:0:15833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 13 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.408790:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:3.0:1788658634.408793:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788658634.408795:0:15833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacde00, rc 0) 00000100:00100000:2.0:1788658634.409065:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d29d269-69a5-47bf-9218-df6c9b443069+9:2351:x1875544076568704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2558us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.409083:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1788658634.410396:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+14:14464:x1875544076568576:12345-192.168.202.3@tcp:101:bash.0 Request processed in 10295us (10648us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788658634.410407:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00010000:00010000:3.0:1788658634.418660:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.418701:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.418709:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.418714:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacda00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658634.418720:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.418728:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.418746:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e56c55f1600) 00010000:00010000:3.0:1788658634.418749:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658634.418754:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.418761:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ebff3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658634.424477:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.424604:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076568832 00000100:00100000:0.0:1788658634.424614:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076568832 00000100:00100000:0.0:1788658634.424710:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:0.0:1788658634.424722:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+13:14464:x1875544076568832:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658634.424759:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658634.424781:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec008 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b248 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.424850:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.424865:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.424888:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658634.424930:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788658634.424935:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658634.424954:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.424964:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.424988:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec008 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 15 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.425004:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.425012:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:0.0:1788658634.425015:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658634.425019:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9800, rc 0) 00000100:00100000:0.0:1788658634.425085:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+14:14464:x1875544076568832:12345-192.168.202.3@tcp:101:bash.0 Request processed in 366us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658634.425093:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1788658634.432059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.432146:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076569088 00000100:00100000:0.0:1788658634.432158:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076569088 00000100:00100000:0.0:1788658634.432225:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:0.0:1788658634.432238:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c6534450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+14:14464:x1875544076569088:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:0.0:1788658634.432611:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c6534450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+15:14464:x1875544076569088:12345-192.168.202.3@tcp:35:bash.0 Request processed in 376us (561us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788658634.432619:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1788658634.510527:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.511068:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076569344 00000100:00100000:0.0:1788658634.511078:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076569344 00000100:00100000:0.0:1788658634.511129:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:0.0:1788658634.511137:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+15:14474:x1875544076569344:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658634.511157:0:15832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658634.511182:0:15832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b24f expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658634.511255:0:15832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788658634.511465:0:15832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec016 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b24f expref: 17 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.511477:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:0.0:1788658634.511479:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658634.511482:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b24f expref: 17 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.511510:0:15832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9c00, rc 0) 00000100:00100000:0.0:1788658634.511596:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+16:14474:x1875544076569344:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 459us (1080us total) trans 8589934600 rc 301/301 00000100:00100000:0.0:1788658634.511604:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:1.0:1788658634.514777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.518847:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076569600 00000100:00100000:0.0:1788658634.518870:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076569600 00000100:00100000:1.0:1788658634.519154:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658634.519169:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+16:14474:x1875544076569600:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1788658634.519479:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+17:14474:x1875544076569600:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 311us (4710us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788658634.519489:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658634.565939:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.566553:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076569856 00000100:00100000:2.0:1788658634.566573:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076569856 00000100:00100000:2.0:1788658634.566718:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:2.0:1788658634.566730:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+17:14477:x1875544076569856:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1788658634.566755:0:15833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658634.566776:0:15833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec024 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b256 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.566897:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ec02b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.566912:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ec02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.566926:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ec02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658634.566939:0:15833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658634.567212:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec024 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b256 expref: 20 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.567232:0:15833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ec02b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b256 expref: 19 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.567241:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658634.567244:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658634.567262:0:15833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b200, rc 0) 00000100:00100000:2.0:1788658634.567350:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+19:14477:x1875544076569856:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 622us (1420us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788658634.567358:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658634.571786:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.572097:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076569984 00000100:00100000:2.0:1788658634.572107:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076569984 00000100:00100000:2.0:1788658634.572168:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:2.0:1788658634.572179:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+19:14477:x1875544076569984:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1788658634.572257:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572277:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572289:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572316:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572324:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572342:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572348:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ac00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658634.572352:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572359:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572385:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658634.572388:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658634.572393:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.572399:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec039 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658634.572478:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+19:14477:x1875544076569984:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 300us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.572485:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:1.0:1788658634.575921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.576062:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076570240 00000100:00100000:3.0:1788658634.576072:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076570240 00000100:00100000:3.0:1788658634.576140:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658634.576150:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+19:14477:x1875544076570240:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1788658634.576388:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+20:14477:x1875544076570240:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 238us (475us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788658634.576395:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1788658634.576660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.577138:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076570368 00000100:00100000:3.0:1788658634.577145:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076570368 00000100:00100000:3.0:1788658634.577193:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1788658634.577201:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+20:2351:x1875544076570368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658634.577212:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658634.577236:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b200/0xf657f176650ec02b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b256 expref: 20 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658634.577254:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:3.0:1788658634.577259:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658634.577289:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+19:2351:x1875544076570368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658634.577296:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1788658634.653460:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658634.653486:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103820160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658634.653582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658634.654064:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103820160 00000100:00100000:0.0:1788658634.654074:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103820160 00000100:00100000:0.0:1788658634.654139:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658634.654152:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103820160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658634.654198:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658634.654254:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103820160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658634.654261:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658634.654488:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103820160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658634.842661:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.842952:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076570624 00000100:00100000:2.0:1788658634.842965:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076570624 00000100:00100000:2.0:1788658634.843071:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:2.0:1788658634.843082:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+19:14508:x1875544076570624:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1788658634.843107:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658634.843130:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec040 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b25d expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.843233:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec047 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.843248:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.843283:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658634.843297:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658634.851475:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec040 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b25d expref: 22 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.851874:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec047 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b25d expref: 21 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.851885:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658634.851888:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658634.851891:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ba00, rc 0) 00000100:00100000:2.0:1788658634.852018:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+21:14508:x1875544076570624:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8936us (9366us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788658634.852028:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:1.0:1788658634.861400:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658634.861465:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658634.861643:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076570880 00000100:00100000:3.0:1788658634.861660:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076570880 00000100:00100000:2.0:1788658634.861751:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076571008 00000100:00100000:2.0:1788658634.861769:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076571008 00000100:00100000:3.0:1788658634.861788:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658634.861806:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+22:14508:x1875544076570880:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1788658634.862340:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:2.0:1788658634.862354:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:2352:x1875544076571008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658634.862375:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658634.862402:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec047 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b25d expref: 23 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.862424:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658634.862429:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658634.862626:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+22:14508:x1875544076570880:12345-192.168.202.3@tcp:35:cat.0 Request processed in 821us (1237us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788658634.862651:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1788658634.862987:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+21:2352:x1875544076571008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 633us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.862999:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:0.0:1788658634.921840:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.921967:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076571264 00000100:00100000:2.0:1788658634.921978:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076571264 00000100:00100000:2.0:1788658634.922088:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1788658634.922100:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+21:14514:x1875544076571264:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:2.0:1788658634.922125:0:15833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658634.922148:0:15833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec055 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b264 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.922253:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.922268:0:15833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 22 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.922276:0:15833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 22 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.922285:0:15833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.922495:0:15833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 22 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.922723:0:15833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 22 pid: 14418 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658634.922759:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820288:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658634.922864:0:15833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 22 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.922874:0:15833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 22 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658634.922883:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820416:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658634.922905:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8817780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658634.926733:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658634.926763:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658634.926827:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076571392 00000100:00100000:1.0:1788658634.926836:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076571392 00010000:00010000:1.0:1788658634.926872:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 23 pid: 14418 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658634.926902:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076571520 00000100:00100000:1.0:1788658634.926905:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076571520 00010000:00010000:1.0:1788658634.926917:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 24 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658634.926932:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:1.0:1788658634.926942:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:2351:x1875544076571392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658634.926956:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658634.926963:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 24 pid: 14418 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.926977:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 24 pid: 14418 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927000:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:1.0:1788658634.927006:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927015:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927020:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658634.927071:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:2351:x1875544076571392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658634.927088:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:1.0:1788658634.927138:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1788658634.927144:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:2351:x1875544076571520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658634.927152:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658634.927156:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 23 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927165:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 23 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927176:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:1.0:1788658634.927180:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927189:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927196:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.927212:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658634.927231:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:2351:x1875544076571520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658634.927237:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00010000:00010000:2.0:1788658634.927515:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec00f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b248 expref: 22 pid: 14418 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658634.927541:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820288:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658634.927554:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ebffa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b241 expref: 21 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658634.927564:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820416:192.168.202.3@tcp:104: 00010000:00010000:2.0:1788658634.927586:0:15833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.927595:0:15833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.927601:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658634.927633:0:15833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658634.927855:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec055 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b264 expref: 22 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.927872:0:15833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b264 expref: 21 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.927880:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658634.927883:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658634.927885:0:15833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891ac00, rc 0) 00000100:00100000:2.0:1788658634.927921:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+21:14514:x1875544076571264:12345-192.168.202.3@tcp:101:dd.0 Request processed in 5824us (6092us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788658634.927928:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:1.0:1788658634.930830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.930943:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076571776 00000100:00100000:0.0:1788658634.930954:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076571776 00000100:00100000:0.0:1788658634.931025:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:0.0:1788658634.931040:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+21:14514:x1875544076571776:12345-192.168.202.3@tcp:36:dd.0 00010000:00010000:0.0:1788658634.931369:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.931389:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.931401:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658634.931475:0:15832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934607 00000004:00010000:0.0:1788658634.931514:0:15832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ee48c1a reply state 00000000f00aa66e transno 8589934608 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658634.931523:0:15832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658634.931650:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14514:x1875544076571776:12345-192.168.202.3@tcp:36:dd.0 Request processed in 612us (829us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788658634.931659:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000020:00080000:0.0:1788658634.931710:0:15832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788658634.933558:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.933595:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.933603:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.933609:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658634.933614:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.933623:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.933642:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:1.0:1788658634.933645:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658634.933650:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.933656:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec06a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658634.935199:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.935298:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076571904 00000100:00100000:2.0:1788658634.935308:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076571904 00000100:00100000:2.0:1788658634.935438:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:2.0:1788658634.935449:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:14514:x1875544076571904:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:2.0:1788658634.935484:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658634.935507:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec071 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b26b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.935594:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec071 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b26b expref: 24 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.935610:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec071 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b26b expref: 24 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.935650:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658634.935653:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658634.935657:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891b600, rc 0) 00000100:00100000:2.0:1788658634.935753:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14514:x1875544076571904:12345-192.168.202.3@tcp:101:dd.0 Request processed in 305us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.935761:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:2.0:1788658634.947950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658634.948058:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076572160 00000100:00100000:1.0:1788658634.948068:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076572160 00000100:00100000:1.0:1788658634.948136:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1788658634.948147:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14514:x1875544076572160:12345-192.168.202.3@tcp:103:dd.0 00010000:00010000:1.0:1788658634.948163:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658634.948189:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec071 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b26b expref: 24 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658634.948228:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:1.0:1788658634.948234:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658634.948318:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:14514:x1875544076572160:12345-192.168.202.3@tcp:103:dd.0 Request processed in 171us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658634.948325:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1788658634.952076:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658634.952169:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076572288 00000100:00100000:2.0:1788658634.952180:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076572288 00000100:00100000:2.0:1788658634.952236:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:2.0:1788658634.952247:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:14514:x1875544076572288:12345-192.168.202.3@tcp:58:dd.0 00010000:00010000:2.0:1788658634.952360:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.952378:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658634.952392:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658634.954813:0:15833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658634.954996:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788658634.955069:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788658634.955194:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:14514:x1875544076572288:12345-192.168.202.3@tcp:58:dd.0 Request processed in 2944us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658634.955206:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:3.0:1788658634.958465:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658634.961024:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076572416 00000100:00100000:0.0:1788658634.961041:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076572416 00000100:00100000:0.0:1788658634.961122:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:0.0:1788658634.961133:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+23:14514:x1875544076572416:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:0.0:1788658634.961154:0:15832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658634.961176:0:15832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b272 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.961233:0:15832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.961245:0:15832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 24 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.961265:0:15832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.961278:0:15832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 24 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.962017:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:0.0:1788658634.962024:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658634.962032:0:15832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 24 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658634.962044:0:15832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d8a00, rc 0) 00000100:00100000:0.0:1788658634.962168:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14514:x1875544076572416:12345-192.168.202.3@tcp:101:dd.0 Request processed in 1036us (3712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658634.962177:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00010000:00010000:0.0:1788658634.975134:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658635.422700:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788658635.422727:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658635.422784:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788658635.422791:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788658635.422948:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1875544103820544:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788658635.423074:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c3e0c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658635.427857:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1875544103820544:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658635.431108:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.431228:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076572544 00000100:00100000:3.0:1788658635.431243:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076572544 00000100:00100000:3.0:1788658635.431308:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1788658635.431319:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14515:x1875544076572544:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788658635.431418:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14515:x1875544076572544:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 Request processed in 100us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.431426:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1788658635.435924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.435973:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.436008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.436042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.436066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.436084:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.436106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.436133:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076573056 00000100:00100000:3.0:1788658635.436142:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076573056 00000100:00100000:3.0:1788658635.436201:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076573312 00000100:00100000:3.0:1788658635.436205:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076573312 00000100:00100000:3.0:1788658635.436221:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076572928 00000100:00100000:3.0:1788658635.436223:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076572928 00000100:00100000:3.0:1788658635.436236:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076573440 00000100:00100000:3.0:1788658635.436238:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076573440 00000100:00100000:3.0:1788658635.436254:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1788658635.436264:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2354:x1875544076573056:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658635.436336:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2354:x1875544076573056:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 72us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.436358:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1788658635.436376:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1788658635.436383:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d29d269-69a5-47bf-9218-df6c9b443069+5:2354:x1875544076573312:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658635.436410:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d29d269-69a5-47bf-9218-df6c9b443069+5:2354:x1875544076573312:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.436416:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1788658635.436429:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1788658635.436435:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2354:x1875544076572928:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658635.436457:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2354:x1875544076572928:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.436462:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1788658635.436472:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1788658635.436477:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d29d269-69a5-47bf-9218-df6c9b443069+5:2354:x1875544076573440:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658635.436513:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d29d269-69a5-47bf-9218-df6c9b443069+5:2354:x1875544076573440:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 35us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.436519:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00080000:3.0:1788658635.436543:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658635.436547:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658635.436558:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076572672 00000100:00100000:3.0:1788658635.436561:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076572672 00000100:00100000:3.0:1788658635.436584:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076573184 00000100:00100000:3.0:1788658635.436587:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076573184 00000100:00100000:3.0:1788658635.436602:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:3.0:1788658635.436608:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d29d269-69a5-47bf-9218-df6c9b443069+9:2354:x1875544076573184:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658635.436651:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d29d269-69a5-47bf-9218-df6c9b443069+9:2354:x1875544076573184:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 42us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.436659:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:3.0:1788658635.436715:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:3.0:1788658635.436722:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14515:x1875544076572672:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788658635.436759:0:14420:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788658635.436841:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14515:x1875544076572672:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 119us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.436848:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:0.0:1788658635.436997:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076572800 00000100:00100000:0.0:1788658635.437002:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076572800 00000100:00100000:0.0:1788658635.437040:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:0.0:1788658635.437047:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2354:x1875544076572800:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658635.437077:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2354:x1875544076572800:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.437084:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:3.0:1788658635.443653:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.443835:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076573568 00000100:00100000:0.0:1788658635.443848:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076573568 00000100:00100000:0.0:1788658635.443917:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:0.0:1788658635.443928:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14515:x1875544076573568:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788658635.444014:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444034:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444066:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444127:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444136:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444144:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444172:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444180:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444186:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658635.444229:0:15832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788658635.444233:0:15832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658635.444249:0:15832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444259:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444266:0:15832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444282:0:15832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444288:0:15832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658635.444292:0:15832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444300:0:15832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444311:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69000) 00010000:00010000:0.0:1788658635.444315:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658635.444318:0:15832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444325:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec086 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444339:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444346:0:15832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444352:0:15832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444357:0:15832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658635.444359:0:15832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444375:0:15832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444384:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e56c3c69800) 00010000:00010000:0.0:1788658635.444386:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658635.444389:0:15832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444394:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec08d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444410:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444417:0:15832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444421:0:15832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444426:0:15832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658635.444428:0:15832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444433:0:15832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444440:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:0.0:1788658635.444442:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658635.444445:0:15832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.444461:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec094 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658635.444559:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14515:x1875544076573568:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 632us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.444567:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:1.0:1788658635.449356:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658635.449446:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076573824 00000100:00100000:2.0:1788658635.449458:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076573824 00000100:00100000:2.0:1788658635.449548:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1788658635.449565:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+24:14515:x1875544076573824:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658635.449595:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658635.449625:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec09b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b279 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.449768:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450044:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450062:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658635.450080:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658635.450192:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450199:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450226:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450235:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658635.450239:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450252:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450264:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658635.450270:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788658635.450277:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450286:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450349:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec09b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b279 expref: 26 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450360:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69000) 00010000:00010000:2.0:1788658635.450362:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658635.450369:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec09b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b279 expref: 26 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.450383:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56c891aa00, rc 0) 00000100:00100000:2.0:1788658635.450471:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+25:14515:x1875544076573824:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 905us (1121us total) trans 8589934609 rc 301/301 00000100:00100000:2.0:1788658635.450501:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:1.0:1788658635.456985:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658635.457091:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076573952 00000100:00100000:2.0:1788658635.457108:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076573952 00000100:00100000:2.0:1788658635.457191:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:2.0:1788658635.457203:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+25:14515:x1875544076573952:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658635.457243:0:15833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658635.457379:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+25:14515:x1875544076573952:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 178us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.457388:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:3.0:1788658635.469732:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.469839:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076574208 00000100:00100000:0.0:1788658635.469863:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076574208 00000100:00100000:0.0:1788658635.469954:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:0.0:1788658635.469966:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eedb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+25:14515:x1875544076574208:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658635.469989:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658635.470012:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec0b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b280 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658635.470814:0:14420:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788658635.470823:0:14420:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788658635.470874:0:14420:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788658635.471165:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.471184:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.471197:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.471268:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec0b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b280 expref: 28 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.471303:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b280 expref: 27 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.471312:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:0.0:1788658635.471315:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658635.471319:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9800, rc 0) 00000100:00100000:0.0:1788658635.471405:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eedb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+27:14515:x1875544076574208:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1441us (1740us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788658635.471413:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:1.0:1788658635.484976:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658635.485071:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076574464 00000100:00100000:2.0:1788658635.485089:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076574464 00000100:00100000:2.0:1788658635.485152:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:2.0:1788658635.485161:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+27:14515:x1875544076574464:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658635.485225:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658635.485252:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b280 expref: 27 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485269:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:2.0:1788658635.485280:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658635.485302:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485316:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485327:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485359:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485366:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485372:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485439:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485447:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485453:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485459:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891aa00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658635.485464:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485473:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485481:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658635.485483:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658635.485487:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485506:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891aa00/0xf657f176650ec0c5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485522:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485528:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485534:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485538:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658635.485541:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485547:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485554:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4b150bb6 (ffff9e56d579c100) 00010000:00010000:2.0:1788658635.485556:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658635.485559:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.485564:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891b600/0xf657f176650ec0cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4b150bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658635.485649:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+26:14515:x1875544076574464:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 488us (682us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658635.485656:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:3.0:1788658635.494245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.498419:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076574592 00000100:00100000:0.0:1788658635.498445:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076574592 00000100:00100000:0.0:1788658635.498646:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1788658635.498660:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+26:14515:x1875544076574592:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658635.498713:0:15832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658635.498747:0:15832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec0d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b287 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.498799:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec0da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.498818:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec0da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.498834:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec0da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.498983:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec0d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b287 expref: 28 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.499015:0:15832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec0da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b287 expref: 27 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.499025:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:0.0:1788658635.499029:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658635.499033:0:15832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d8e00, rc 0) 00000100:00100000:0.0:1788658635.499129:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+27:14515:x1875544076574592:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 472us (4904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.499138:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:2.0:1788658635.504219:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658635.514977:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076574848 00000100:00100000:1.0:1788658635.515000:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076574848 00000100:00100000:1.0:1788658635.515117:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:1.0:1788658635.515132:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+27:14515:x1875544076574848:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788658635.516030:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.516058:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.516075:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658635.519025:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788658635.519054:0:14420:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 526658387722ns, next at 527658382592ns, rc = 0 00000004:00010000:1.0:1788658635.520444:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076776a2f reply state 00000000a15bfba8 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658635.520506:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788658635.520896:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+29:14515:x1875544076574848:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 5761us (16679us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788658635.520908:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1788658635.529704:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658635.529882:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076574976 00000100:00100000:1.0:1788658635.529896:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076574976 00000100:00100000:1.0:1788658635.529981:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:1.0:1788658635.530433:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+29:14515:x1875544076574976:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658635.530547:0:15833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658635.530577:0:15833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b28e expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.530929:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 30 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.530950:0:15833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 30 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.530976:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:1.0:1788658635.530980:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788658635.530985:0:15833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35600, rc 0) 00000100:00100000:1.0:1788658635.531588:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+30:14515:x1875544076574976:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1584us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.531598:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00010000:00010000:0.0:1788658635.532362:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.532379:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.532389:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.532395:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658635.532401:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.532409:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.532427:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:0.0:1788658635.532431:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788658635.532437:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.532466:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec0e1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658635.541233:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.541536:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076575104 00000100:00100000:3.0:1788658635.541551:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076575104 00000100:00100000:3.0:1788658635.541685:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:3.0:1788658635.541699:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2352:x1875544076575104:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788658635.542212:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2352:x1875544076575104:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 514us (994us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788658635.542221:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1788658635.553255:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658635.553648:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076575360 00000100:00100000:1.0:1788658635.553708:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076575360 00000100:00100000:1.0:1788658635.553839:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658635.553853:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+29:14515:x1875544076575360:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788658635.554213:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+30:14515:x1875544076575360:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 361us (971us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788658635.554223:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658635.557713:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.557911:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076575616 00000100:00100000:3.0:1788658635.557925:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076575616 00000100:00100000:3.0:1788658635.558218:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:3.0:1788658635.558232:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+30:14515:x1875544076575616:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788658635.558751:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+30:14515:x1875544076575616:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 519us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.558780:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:1.0:1788658635.561733:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.561982:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076575744 00000100:00100000:0.0:1788658635.562100:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076575744 00000100:00100000:0.0:1788658635.562222:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1788658635.562235:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+30:14515:x1875544076575744:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658635.562264:0:15832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658635.562295:0:15832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec0ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b295 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.562409:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.562427:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.562442:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658635.562968:0:15832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658635.562995:0:15832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.563046:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec0ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b295 expref: 32 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.563071:0:15832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b295 expref: 31 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.563103:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:0.0:1788658635.563107:0:15832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788658635.563112:0:15832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9800, rc 0) 00000100:00100000:0.0:1788658635.563239:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+31:14515:x1875544076575744:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1006us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.563247:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:2.0:1788658635.572772:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.573776:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076575872 00000100:00100000:3.0:1788658635.573800:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076575872 00000100:00100000:3.0:1788658635.573945:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1788658635.573960:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2352:x1875544076575872:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658635.573985:0:15101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658635.574185:0:15101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b29c expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658635.574224:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc3cb, blocks: 0x1 00010000:00010000:3.0:1788658635.574254:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788658635.574260:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658635.574273:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 7 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.574298:0:15101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 7 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.574315:0:15101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacda00, rc 0) 00000100:00100000:0.0:1788658635.579931:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:2352:x1875544076575872:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 5865us (7064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.579947:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658635.587283:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.590585:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076576128 00000100:00100000:0.0:1788658635.590608:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076576128 00000100:00100000:0.0:1788658635.590765:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:2.0:1788658635.590914:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+31:14515:x1875544076576128:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788658635.591096:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+31:14515:x1875544076576128:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 321us (3826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.591105:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:1.0:1788658635.598968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.605412:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076576256 00000100:00100000:3.0:1788658635.605436:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076576256 00000100:00100000:2.0:1788658635.606493:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:2.0:1788658635.606510:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+31:14515:x1875544076576256:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788658635.697957:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+31:14515:x1875544076576256:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 91433us (98985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.697975:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000001:00080000:0.0:1788658635.698183:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:0.0:1788658635.698216:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000004:00080000:0.0:1788658635.698226:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788658635.698249:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000100:00100000:0.0:1788658635.699206:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103820672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788658635.699303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658635.699504:0:15581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103820672 00000100:00100000:2.0:1788658635.699526:0:15581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103820672 00000100:00100000:2.0:1788658635.699594:0:15581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658635.699604:0:15581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103820672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788658635.699857:0:15581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788658635.699862:0:15581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788658635.699864:0:15581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788658635.699866:0:15581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788658635 -> 1788658635 00002000:00010000:2.0:1788658635.699869:0:15581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788658635.699918:0:15581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875544103820672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (615us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788658635.699926:0:15581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788658635.700460:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e56fefd8700/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788658635.700479:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103820672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788658635.701452:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658635.701628:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076576384 00000100:00100000:1.0:1788658635.701639:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076576384 00000100:00100000:1.0:1788658635.701757:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:1.0:1788658635.701769:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:2351:x1875544076576384:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788658635.701909:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:2351:x1875544076576384:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 142us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.701918:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:1.0:1788658635.721425:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.722626:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076576640 00000100:00100000:0.0:1788658635.722646:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076576640 00000100:00100000:0.0:1788658635.722770:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:0.0:1788658635.722783:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+14:14515:x1875544076576640:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788658635.722882:0:15832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658635.722922:0:15832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec0f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b295 expref: 14 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.722949:0:15832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:0.0:1788658635.722956:0:15832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658635.723002:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.723021:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.723034:0:15832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658635.723303:0:15832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da84ea14 reply state 00000000ec2b0f5d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658635.723315:0:15832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658635.723483:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+15:14515:x1875544076576640:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 691us (2062us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788658635.723492:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00010000:00010000:1.0:1788658635.728241:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.728268:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.728281:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.728288:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658635.728323:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.728333:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.728357:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:1.0:1788658635.728361:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658635.728367:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.728374:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec104 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658635.728796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658635.728904:0:15581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076576768 00000100:00100000:2.0:1788658635.728916:0:15581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076576768 00000100:00100000:2.0:1788658635.729029:0:15581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1788658635.729041:0:15581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:2351:x1875544076576768:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788658635.729321:0:15581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788658635.729325:0:15581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788658634 00002000:00010000:2.0:1788658635.729328:0:15581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788658634 00002000:00010000:2.0:1788658635.729330:0:15581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788658635 -> 1788658634 00002000:00010000:2.0:1788658635.729333:0:15581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788658635.729418:0:15581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+8:2351:x1875544076576768:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 378us (628us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788658635.729426:0:15581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1788658635.733187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.742866:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076576896 00000100:00100000:0.0:1788658635.742889:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076576896 00000100:00100000:0.0:1788658635.744099:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1788658635.744115:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+8:2352:x1875544076576896:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788658635.744180:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744227:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658635.744232:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658635.744241:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744261:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744304:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744314:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744325:0:15100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744333:0:15100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658635.744339:0:15100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744350:0:15100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744368:0:15100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.744384:0:15100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec10b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658635.745108:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+8:2352:x1875544076576896:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 990us (11929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.745122:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1788658635.755341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658635.757800:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076577152 00000100:00100000:1.0:1788658635.757939:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076577152 00000100:00100000:1.0:1788658635.758150:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:1.0:1788658635.758165:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+14:14515:x1875544076577152:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788658635.758291:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.758314:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.758330:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.759214:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.759237:0:15833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 15 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.759257:0:15833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.759312:0:15833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 15 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.759331:0:15833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 15 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658635.759351:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820800:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658635.759623:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f4500600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658635.766480:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658635.769274:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076577280 00000100:00100000:3.0:1788658635.769298:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076577280 00010000:00010000:3.0:1788658635.769373:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 16 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658635.769478:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1788658635.769490:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+16:2352:x1875544076577280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658635.769517:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658635.769527:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 16 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.769543:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 16 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.769575:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:3.0:1788658635.769581:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.769594:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.769602:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.769629:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658635.769757:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+16:2352:x1875544076577280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 268us (3309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.769765:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00010000:00010000:1.0:1788658635.770482:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec0e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b28e expref: 15 pid: 15833 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658635.770515:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103820800:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658635.770543:0:15833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.770554:0:15833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.770560:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658635.770978:0:15833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000001:00080000:1.0:1788658635.771335:0:15833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934615 00000001:00080000:1.0:1788658635.771385:0:15833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000100:00100000:1.0:1788658635.771736:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:15833:1875544103820928:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788658635.776550:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.776631:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658635.776835:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103820928 00000100:00100000:3.0:1788658635.776851:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103820928 00000100:00100000:3.0:1788658635.776921:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658635.776931:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15833:x1875544103820928:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788658635.777111:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15833:x1875544103820928:12345-0@lo:1000:mdt00_004.0 Request processed in 181us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.777120:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658635.777372:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:15833:1875544103820928:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788658635.779196:0:15833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000100:00100000:2.0:1788658635.779345:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:15833:1875544103821056:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788658635.779439:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.779545:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103821056 00000100:00100000:1.0:1788658635.779571:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103821056 00000100:00100000:1.0:1788658635.779643:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658635.779655:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15833:x1875544103821056:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788658635.780001:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15833:x1875544103821056:12345-0@lo:1000:mdt00_004.0 Request processed in 347us (561us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788658635.780010:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658635.780859:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658635.780923:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:15833:1875544103821056:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788658635.780985:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.780998:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.781007:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782161:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658635.782179:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782215:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782238:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:2.0:1788658635.782241:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658635.782248:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782255:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec119 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782306:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782313:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782319:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782325:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ba00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658635.782328:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782334:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782343:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658635.782345:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658635.782357:0:15833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 18 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782383:0:15833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 18 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782394:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 18 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.782840:0:15833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 18 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658635.782865:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103821184:192.168.202.3@tcp:105: 00000100:00100000:2.0:1788658635.782989:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658635.787570:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15833:1875544103821184:192.168.202.3@tcp:105: 00010000:00010000:3.0:1788658635.787621:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787635:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec078 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787724:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787742:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787757:0:15833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787772:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787779:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787786:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787793:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deaccc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658635.787798:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787831:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787844:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:3.0:1788658635.787848:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658635.787853:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787859:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deaccc00/0xf657f176650ec120 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787869:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787875:0:15833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787880:0:15833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787885:0:15833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658635.787888:0:15833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787894:0:15833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787901:0:15833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:3.0:1788658635.787903:0:15833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658635.787906:0:15833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658635.787921:0:15833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35800/0xf657f176650ec112 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658635.788271:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+18:14515:x1875544076577152:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 30107us (32944us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788658635.788284:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000020:00080000:3.0:1788658635.788293:0:15833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788658635.788694:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788658635.788700:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658635.788733:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788658635.788739:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788658635.789183:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658635.789414:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076577408 00000100:00100000:1.0:1788658635.789424:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076577408 00000100:00100000:1.0:1788658635.789485:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:1.0:1788658635.789497:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+18:14514:x1875544076577408:12345-192.168.202.3@tcp:49:dd.0 00000100:00100000:1.0:1788658635.789655:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+18:14514:x1875544076577408:12345-192.168.202.3@tcp:49:dd.0 Request processed in 160us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.789708:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:1.0:1788658635.796372:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658635.796485:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076577664 00000100:00100000:2.0:1788658635.796514:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076577664 00000100:00100000:2.0:1788658635.796610:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658635.796623:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c6534050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+18:14515:x1875544076577664:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788658635.798736:0:14422:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788658635.798873:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00010000:00010000:2.0:1788658635.798951:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.798977:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.801652:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.801688:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.801696:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.801703:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.801733:0:14422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788658635.801890:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c6534050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+20:14515:x1875544076577664:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 5264us (5522us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788658635.801901:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000020:00080000:2.0:1788658635.801908:0:14422:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788658635.802239:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658635.802250:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.802259:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891ba00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658635.802264:0:16118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.802275:0:16118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.802294:0:16118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:0.0:1788658635.802298:0:16118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788658635.802303:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.802309:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ba00/0xf657f176650ec127 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.802328:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658635.802330:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658635.802332:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658635.985373:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658635.985494:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658635.986090:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658635.986872:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076577792 00000100:00100000:0.0:1788658635.986891:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076577792 00000100:00100000:0.0:1788658635.986997:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076577920 00000100:00100000:0.0:1788658635.987001:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076577920 00000100:00100000:0.0:1788658635.987158:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658635.987172:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:2351:x1875544076577792:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:0.0:1788658635.987220:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.987250:0:15105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 9 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.987260:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788658635.987265:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658635.987271:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.987324:0:15105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 9 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.987342:0:15105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 9 pid: 15101 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658635.987361:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57004fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15105:1875544103821312:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658635.987498:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56de8dd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658635.988281:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578048 00000100:00100000:3.0:1788658635.988291:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578048 00000100:00100000:0.0:1788658635.992091:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57004fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15105:1875544103821312:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658635.992139:0:15105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658635.997247:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658636.004877:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658636.005145:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578176 00000100:00100000:2.0:1788658636.005160:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578176 00010000:00010000:2.0:1788658636.005226:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 11 pid: 15101 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658636.005275:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:2.0:1788658636.005290:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+11:2352:x1875544076578176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658636.005312:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658636.005367:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 11 pid: 15101 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658636.005384:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 11 pid: 15101 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658636.005413:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ef0842/0xf657f176650ec0fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b29c expref: 11 pid: 15101 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658636.005435:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658636.005439:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658636.005447:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658636.005458:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658636.005496:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658636.005589:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:2352:x1875544076578176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 302us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658636.005598:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00010000:00010000:0.0:1788658636.005782:0:15105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.005792:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658636.132867:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1788658636.132881:0:15105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788658634 -> 1788658635 00002000:00010000:0.0:1788658636.132885:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788658636.132905:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.132920:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.132931:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.132938:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658636.132943:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.132954:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.133007:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.133018:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec12e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658636.133185:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+11:2351:x1875544076577792:12345-192.168.202.3@tcp:4:dd.0 Request processed in 146009us (147820us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788658636.133199:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658636.133246:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:0.0:1788658636.133262:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:2351:x1875544076577920:12345-192.168.202.3@tcp:4:dd.0 00002000:00010000:0.0:1788658636.133318:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9cc3cb, atime: 0x6a9cc3ca, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1788658636.133326:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.133340:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788658636.133346:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658636.133354:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.133369:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658636.134131:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788658636.134154:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1788658636.196339:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1788658636.196511:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1788658636.196518:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1788658636.196568:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.196583:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.196594:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.196602:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658636.196608:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.196618:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.196644:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.196697:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec135 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658636.196838:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2351:x1875544076577920:12345-192.168.202.3@tcp:4:dd.0 Request processed in 63575us (211335us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788658636.197762:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:0.0:1788658636.197813:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658636.197830:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076578048:12345-192.168.202.3@tcp:4:dd.0 00002000:00010000:0.0:1788658636.197916:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9cc3cb, atime: 0x6a9cc3ca, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1788658636.197927:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.197942:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788658636.197947:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658636.197954:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.197970:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658636.290199:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00000001:00080000:3.0:1788658636.290274:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788658636.290308:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788658636.290388:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.290506:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.290516:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.290524:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658636.290530:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.290579:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.290600:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.290606:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec13c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658636.292064:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076578048:12345-192.168.202.3@tcp:4:dd.0 Request processed in 94226us (305959us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788658636.292082:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:2.0:1788658636.308005:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658636.308108:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658636.308208:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658636.308416:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578304 00000100:00100000:1.0:1788658636.308430:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578304 00000100:00100000:1.0:1788658636.308532:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578432 00000100:00100000:1.0:1788658636.308536:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578432 00000100:00100000:1.0:1788658636.308569:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:1.0:1788658636.308581:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+6:2351:x1875544076578304:12345-192.168.202.3@tcp:4:dd.0 00002000:00010000:1.0:1788658636.308658:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9cc3cb, atime: 0x6a9cc3ca, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788658636.308693:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.308748:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788658636.308753:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658636.308762:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.308780:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658636.309118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658636.309137:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658636.309288:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658636.309303:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788658636.310765:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578560 00000100:00100000:1.0:1788658636.310778:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578560 00000100:00100000:1.0:1788658636.310846:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788658636.310855:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578688 00000100:00100000:1.0:1788658636.310869:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578688 00000100:00100000:1.0:1788658636.310887:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788658636.310893:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578816 00000100:00100000:1.0:1788658636.310896:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578816 00000100:00100000:2.0:1788658636.319843:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1788658636.319876:0:16649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:2351:x1875544076578432:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:2.0:1788658636.319939:0:16649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658636.319961:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658636.319967:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658636.319975:0:16649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658636.319994:0:16649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658636.357202:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1788658636.368486:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:1.0:1788658636.368499:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788658635 00002000:00010000:1.0:1788658636.368502:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1788658636.368521:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368536:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368547:0:15107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368586:0:15107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658636.368591:0:15107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368601:0:15107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368623:0:15107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368631:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec143 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658636.368786:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+12:2351:x1875544076578304:12345-192.168.202.3@tcp:4:dd.0 Request processed in 60202us (60795us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788658636.368797:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:1.0:1788658636.368843:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1788658636.368857:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+11:2352:x1875544076578560:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:1.0:1788658636.368907:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368920:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658636.368925:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658636.368931:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.368959:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658636.404123:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:3.0:1788658636.410508:0:16649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1788658636.410521:0:16649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1788658636.410539:0:16649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.410554:0:16649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.410576:0:16649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.410584:0:16649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658636.410605:0:16649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.410617:0:16649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.410642:0:16649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.410651:0:16649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000597807a8/0xf657f176650ec14a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658636.411050:0:16649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+11:2351:x1875544076578432:12345-192.168.202.3@tcp:4:dd.0 Request processed in 91180us (102935us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788658636.411062:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658636.411610:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658636.411625:0:16649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:2352:x1875544076578688:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:3.0:1788658636.411952:0:16649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.411970:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658636.411975:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658636.411981:0:16649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.411996:0:16649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658636.457209:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1788658636.457510:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:3.0:1788658636.457529:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457541:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457551:0:15107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457558:0:15107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658636.457573:0:15107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457583:0:15107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457602:0:15107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457610:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec151 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658636.457735:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+10:2352:x1875544076578560:12345-192.168.202.3@tcp:4:dd.0 Request processed in 88878us (149521us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788658636.457760:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1788658636.457791:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658636.457802:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+9:2351:x1875544076578816:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:3.0:1788658636.457835:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457847:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658636.457852:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658636.457858:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658636.457999:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658636.502749:0:16649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788658636.502760:0:16649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788658636.502777:0:16649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.502790:0:16649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.502799:0:16649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.502807:0:16649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacc800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658636.502812:0:16649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.502821:0:16649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.502842:0:16649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658636.502867:0:16649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d69eae4/0xf657f176650ec158 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658636.502970:0:16649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+11:2352:x1875544076578688:12345-192.168.202.3@tcp:4:dd.0 Request processed in 91345us (193849us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788658636.502980:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000001:00080000:3.0:1788658636.503469:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1788658636.535792:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788658636.535816:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.535830:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.535839:0:15107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.535846:0:15107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacd000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658636.535852:0:15107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.535874:0:15107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.535909:0:15107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658636.535917:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e588831/0xf657f176650ec15f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658636.536015:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+7:2351:x1875544076578816:12345-192.168.202.3@tcp:4:dd.0 Request processed in 78212us (226872us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788658636.536027:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000001:00080000:1.0:1788658636.537607:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1788658637.021740:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658638.047869:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788658638.151140:0:16686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788658639.068823:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658639.261064:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103821696:0@lo:400:kworker.0 00000100:00100000:1.0:1788658639.261371:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658639.261444:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658639.261452:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103821824:0@lo:400:kworker.0 00000100:00100000:1.0:1788658639.261480:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658639.261540:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103821824 00000100:00100000:1.0:1788658639.261551:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103821824 00000100:00100000:1.0:1788658639.261604:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658639.261612:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103821824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658639.261697:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103821824:12345-0@lo:400:kworker.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658639.261706:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658639.262257:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103821696 00000100:00100000:3.0:1788658639.262264:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103821696 00000100:00100000:3.0:1788658639.262311:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658639.262320:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103821696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658639.262362:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103821696:12345-0@lo:400:kworker.0 Request processed in 43us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658639.262368:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788658639.262386:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658639.262461:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103821568:0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.262496:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658639.262530:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103822080:0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.262554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658639.262575:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788658639.262581:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103821440:0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.262608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658639.262630:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103821952:0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.262649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658639.262694:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822080 00000100:00100000:0.0:1788658639.262711:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822080 00000100:00100000:0.0:1788658639.262740:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103821952 00000100:00100000:0.0:1788658639.262743:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103821952 00000100:00100000:0.0:1788658639.262761:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658639.262767:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103822080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.262803:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103822080:12345-0@lo:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658639.262810:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658639.262837:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658639.262843:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103821952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.262871:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103821952:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658639.262876:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658639.262894:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103821568 00000100:00100000:0.0:1788658639.262897:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103821568 00000100:00100000:0.0:1788658639.262921:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658639.262927:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103821568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.262957:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57004f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103821568:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658639.262963:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788658639.262991:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788658639.262995:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658639.263029:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103821952:0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.263040:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788658639.263045:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e56fefd8700, transno 8589934595 00000004:00080000:0.0:1788658639.263058:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788658639.263082:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103821568:0@lo:400:kworker.0 00000100:00100000:0.0:1788658639.263102:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103822080:0@lo:400:kworker.0 00000100:00100000:3.0:1788658639.263795:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103821824:0@lo:400:kworker.0 00000100:00100000:3.0:1788658639.263809:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103821696:0@lo:400:kworker.0 00000100:00100000:2.0:1788658639.264415:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103821440 00000100:00100000:2.0:1788658639.264425:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103821440 00000100:00100000:2.0:1788658639.264471:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788658639.264480:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103821440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658639.264549:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103821440:12345-0@lo:400:kworker.0 Request processed in 71us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658639.264557:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788658639.265157:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658639.265172:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103822208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658639.265213:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658639.266118:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822208 00000100:00100000:0.0:1788658639.266138:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822208 00000100:00100000:0.0:1788658639.266196:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658639.266205:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103822208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658639.266246:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658639.266316:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103822208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658639.266323:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658639.266364:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103821440:0@lo:400:kworker.0 00000100:00100000:1.0:1788658639.266716:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103822208:0@lo:13:osp-pre-1-0.0 Debug log: 29191 lines, 29191 kept, 0 dropped, 0 bad.